CN111274230A - Data migration management method, device, equipment and storage medium - Google Patents
Data migration management method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN111274230A CN111274230A CN202010224116.9A CN202010224116A CN111274230A CN 111274230 A CN111274230 A CN 111274230A CN 202010224116 A CN202010224116 A CN 202010224116A CN 111274230 A CN111274230 A CN 111274230A
- Authority
- CN
- China
- Prior art keywords
- data migration
- bandwidth occupation
- task
- bandwidth
- migration task
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000005012 migration Effects 0.000 title claims abstract description 276
- 238000013508 migration Methods 0.000 title claims abstract description 276
- 238000007726 management method Methods 0.000 title claims abstract description 46
- 230000004044 response Effects 0.000 claims abstract description 89
- 238000012549 training Methods 0.000 claims description 60
- 238000000034 method Methods 0.000 claims description 29
- 238000004891 communication Methods 0.000 claims description 14
- 238000004590 computer program Methods 0.000 claims description 13
- 230000008569 process Effects 0.000 description 9
- 230000009471 action Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 238000012423 maintenance Methods 0.000 description 3
- 230000002776 aggregation Effects 0.000 description 2
- 238000004220 aggregation Methods 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 239000003795 chemical substances by application Substances 0.000 description 1
- 230000001186 cumulative effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/214—Database migration support
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0876—Network utilisation, e.g. volume of load or congestion level
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/60—Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources
- H04L67/62—Establishing a time schedule for servicing the requests
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Environmental & Geological Engineering (AREA)
- Computing Systems (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The embodiment of the invention provides a management method, a management device, management equipment and a storage medium for data migration. The management method of the data migration is applied to a management platform of a data migration task, and after the data migration task is obtained, the first bandwidth occupation amount of the data migration task at a specified time for a special line broadband to be utilized is determined; the specified time belongs to a time period between the earliest starting time and the latest starting time of the data migration task; determining a service response task using a private line broadband; predicting the bandwidth occupation amount of the service response task on the private line broadband at the specified time to obtain a second bandwidth occupation amount; and when the sum of the first bandwidth occupation amount and the second bandwidth occupation amount meets the preset flow control condition corresponding to the private line broadband, stopping executing the data migration task at the specified time. The scheme can reduce the execution abnormity of the service response task which uses the same private line broadband with the data migration.
Description
Technical Field
The present invention relates to the field of data migration technologies, and in particular, to a method, an apparatus, a device, and a storage medium for managing data migration.
Background
In order to cope with the characteristics of mass data of the internet service, the data may be stored by the storage cluster, and a service response task with respect to the implementation of the internet service may be performed by the execution cluster. On this basis, if the execution cluster needs to use the data stored by the storage cluster when executing the service response task, the data migration task needs to be executed before the task is executed. Among these, the so-called data migration tasks are: data stored by the storage cluster is migrated to the task of the execution cluster.
However, the inventor finds out in the process of implementing the invention that:
due to the characteristics of mass data of internet services, it is likely that a large amount of data needs to be migrated when a data migration task is performed, thereby occupying a large amount of bandwidth. Therefore, in a scenario where the data migration task and the service response task share the same private line broadband, there is not enough available bandwidth for the service response task to occupy in the private line broadband occupied by the data migration task, and the service response task has a problem of abnormal execution.
Disclosure of Invention
Embodiments of the present invention provide a method, an apparatus, a device, and a storage medium for managing data migration, so as to achieve an effect of reducing execution exceptions of a service response task that uses the same private line broadband as a data migration task. The specific technical scheme is as follows:
in a first aspect, an embodiment of the present invention provides a management method for data migration, which is applied to a management platform for a data migration task, and the method includes:
after a data migration task is obtained, determining the first bandwidth occupation amount of the data migration task at a specified time for a special line broadband to be utilized; the specified time belongs to a time period between the earliest starting time and the latest starting time of the data migration task;
determining a service response task utilizing the private line broadband;
predicting the bandwidth occupation amount of the service response task on the private line broadband at the specified time to obtain a second bandwidth occupation amount;
and when the sum of the first bandwidth occupation amount and the second bandwidth occupation amount meets the preset flow control condition corresponding to the private line broadband, stopping executing the data migration task at the specified time.
Optionally, the sum of the first bandwidth occupation amount and the second bandwidth occupation amount meets the flow control condition corresponding to the dedicated broadband, and includes:
and the sum of the first bandwidth occupation amount and the second bandwidth occupation amount is greater than the bandwidth safety threshold corresponding to the private line broadband.
Optionally, the predicting the bandwidth occupation amount of the service response task on the dedicated line broadband at the specified time to obtain a second bandwidth occupation amount includes:
predicting the bandwidth occupation amount of the special line broadband at the specified time by the service response task by utilizing a first time sequence prediction model obtained by pre-training based on the first historical bandwidth occupation amount of the service response task to the special line broadband at a plurality of continuous first historical times to obtain a second bandwidth occupation amount;
any one first historical time is before the designated time, and a designated time step is arranged between adjacent first historical times;
the first time sequence prediction model is a model which is obtained based on training of a first training sample set and used for predicting bandwidth occupation, the first training sample set comprises a first sample sequence, the first sample sequence comprises first sample bandwidth occupation of the service response task on the special bandwidth at a plurality of continuous first sample moments, and the adjacent first sample moments are separated by the specified time step.
Optionally, the bandwidth occupation of the plurality of first samples is obtained by the following steps:
and aiming at each first sample moment, searching the historical bandwidth occupation quantity which occupies the first sample moment and occupies the private line broadband from a plurality of pre-stored historical bandwidth occupation quantities aiming at the service response task to obtain the plurality of first sample bandwidth occupation quantities.
Optionally, the determining the first bandwidth occupation amount of the data migration task at a specified time for the dedicated line broadband to be utilized includes:
if the data migration task is started, acquiring the bandwidth occupation amount of the data migration task on the special line broadband by using a specified interface, and taking the bandwidth occupation amount as the first bandwidth occupation amount of the data migration task on the special line broadband to be utilized at a specified time; the designated interface is an interface used for recording bandwidth occupation in a module for executing the data migration task;
the stopping of the execution of the data migration task at the specified time includes:
and stopping data migration performed for the data migration task at the specified time.
Optionally, the determining the first bandwidth occupation amount of the data migration task at a specified time for the dedicated line broadband to be utilized includes:
if the data migration task is not started, predicting to obtain first bandwidth occupation of the data migration task at a specified time by using a second time sequence prediction model obtained by pre-training based on second historical bandwidth occupation of the data migration task at a plurality of continuous second historical times for the special line broadband to be used; any second historical time is before the earliest starting time, and the interval between adjacent second historical times is a specified time step;
the second time sequence prediction model is a model which is obtained based on a second training sample set through training and is used for predicting bandwidth occupation, the second training sample set comprises a second sample sequence, the second sample sequence comprises second sample bandwidth occupation of the data migration task on the to-be-utilized special bandwidth at a plurality of continuous second sample moments, and the time step length of the adjacent second sample moments is specified;
the stopping of the execution of the data migration task at the specified time includes:
if the data migration task is not started at the specified time, stopping starting the data migration task at the specified time;
and if the data migration task is started at the specified time, stopping the data migration performed on the data migration task at the specified time.
In a second aspect, an embodiment of the present invention provides a management apparatus for data migration, which is applied to a management platform for a data migration task, and includes:
the first bandwidth occupation amount determining module is used for determining the first bandwidth occupation amount of the data migration task at a specified time for the to-be-utilized private line broadband after the data migration task is obtained; the specified time belongs to a time period between the earliest starting time and the latest starting time of the data migration task;
the second bandwidth occupation prediction module is used for determining a service response task utilizing the private line broadband; predicting the bandwidth occupation amount of the service response task on the private line broadband at the specified time to obtain a second bandwidth occupation amount;
and the flow control module is used for stopping executing the data migration task at the specified time when the sum of the first bandwidth occupation amount and the second bandwidth occupation amount meets the flow control condition corresponding to the preset private line broadband.
Optionally, the sum of the first bandwidth occupation amount and the second bandwidth occupation amount meets the flow control condition corresponding to the dedicated broadband, and includes:
and the sum of the first bandwidth occupation amount and the second bandwidth occupation amount is greater than the bandwidth safety threshold corresponding to the private line broadband.
Optionally, the second bandwidth occupation prediction module is specifically configured to:
predicting the bandwidth occupation amount of the special line broadband at the specified time by the service response task by utilizing a first time sequence prediction model obtained by pre-training based on the first historical bandwidth occupation amount of the service response task to the special line broadband at a plurality of continuous first historical times to obtain a second bandwidth occupation amount;
any one first historical time is before the designated time, and a designated time step is arranged between adjacent first historical times;
the first time sequence prediction model is a model which is obtained based on training of a first training sample set and used for predicting bandwidth occupation, the first training sample set comprises a first sample sequence, the first sample sequence comprises first sample bandwidth occupation of the service response task on the special bandwidth at a plurality of continuous first sample moments, and the adjacent first sample moments are separated by the specified time step.
Optionally, the bandwidth occupation of the plurality of first samples is obtained by the following steps:
and aiming at each first sample moment, searching the historical bandwidth occupation quantity which occupies the first sample moment and occupies the private line broadband from a plurality of pre-stored historical bandwidth occupation quantities aiming at the service response task to obtain the plurality of first sample bandwidth occupation quantities.
Optionally, the first bandwidth occupancy determination module is specifically configured to:
if the data migration task is started, acquiring the bandwidth occupation amount of the data migration task on the special line broadband by using a specified interface, and taking the bandwidth occupation amount as the first bandwidth occupation amount of the data migration task on the special line broadband to be utilized at a specified time; the designated interface is an interface used for recording bandwidth occupation in a module for executing the data migration task;
the flow control module is specifically configured to:
and stopping data migration performed for the data migration task at the specified time.
Optionally, the first bandwidth occupancy determination module is specifically configured to:
if the data migration task is not started, predicting to obtain first bandwidth occupation of the data migration task at a specified time by using a second time sequence prediction model obtained by pre-training based on second historical bandwidth occupation of the data migration task at a plurality of continuous second historical times for the special line broadband to be used; any second historical time is before the earliest starting time, and the interval between adjacent second historical times is a specified time step;
the second time sequence prediction model is a model which is obtained based on a second training sample set through training and is used for predicting bandwidth occupation, the second training sample set comprises a second sample sequence, the second sample sequence comprises second sample bandwidth occupation of the data migration task on the to-be-utilized special bandwidth at a plurality of continuous second sample moments, and the time step length of the adjacent second sample moments is specified;
the flow control module is specifically configured to:
if the data migration task is not started at the specified time, stopping starting the data migration task at the specified time;
and if the data migration task is started at the specified time, stopping the data migration performed on the data migration task at the specified time.
In a third aspect, an embodiment of the present invention provides an electronic device, including:
the system comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory complete mutual communication through the bus; a memory for storing a computer program; and a processor, configured to execute the program stored in the memory, and implement the steps of the data migration management method according to the first aspect.
In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, where a computer program is stored in the storage medium, and when the computer program is executed by a processor, the steps of the management method for data migration provided in the first aspect are implemented.
In the scheme provided by the invention, after the management platform of the data migration task obtains the data migration task, the first bandwidth occupation amount of the data migration task at the appointed time for the special line broadband to be utilized is determined, and the service response task utilizing the special line broadband is determined; the bandwidth occupation amount of the service response task on the private line broadband at the appointed time is predicted to obtain a second bandwidth occupation amount, and therefore when the sum of the first bandwidth occupation amount and the second bandwidth occupation amount meets the flow control condition corresponding to the preset private line bandwidth, the data migration task is stopped at the appointed time; the specified time belongs to a time period between the earliest start time and the latest start time of the data migration task. Therefore, the execution of the data migration task is stopped at the designated time, the scheduled execution of the data migration task can be considered, the bandwidth which can be used by the service response task exists in the private line broadband used by the data migration task, and the service response task can be normally executed, so that the execution abnormity of the service response task which uses the same private line broadband as the data migration task is reduced.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below.
Fig. 1 is a flowchart illustrating a management method for data migration according to an embodiment of the present invention;
fig. 2 is a flowchart illustrating a management method for data migration according to another embodiment of the present invention;
FIG. 3 is a diagram illustrating an example of an application of a management method for data migration according to another embodiment of the present invention;
fig. 4 is a schematic structural diagram of a management apparatus for data migration according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
In order to make those skilled in the art better understand the technical solution of the present invention, the technical solution in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
First, a method for managing data migration according to an embodiment of the present invention will be described.
The management method for data migration provided in the embodiments of the present invention may be applied to a management platform for a data migration task, where the platform may specifically include a desktop computer, a portable computer, an internet television, an intelligent mobile terminal, a wearable intelligent terminal, a server, and the like, and is not limited herein, and any electronic device that can implement the embodiments of the present invention may be used as a management platform for a data migration task, and belongs to the protection scope of the embodiments of the present invention.
As shown in fig. 1, a flow of a management method for data migration according to an embodiment of the present invention may include:
s101, after the data migration task is obtained, the first bandwidth occupation amount of the data migration task at the appointed time for the to-be-utilized private line broadband is determined. Wherein the specified time belongs to a time period between the earliest starting time and the latest starting time of the data migration task.
In a specific application, the data migration task may be acquired in various ways. For example, the management platform of the data migration task may receive the data migration task submitted by the operation and maintenance staff, or when the management platform of the data migration task is in communication connection with the execution cluster and the storage cluster and is used for creating the data migration task, the management platform of the data migration task may directly read the data migration task created by the management platform itself. Any method capable of obtaining the data migration task can be used in the present invention, and the present embodiment does not limit this.
In addition, the data migration task usually indicates the identification of the agent dedicated line broadband used by the data migration task, and the earliest starting time and the latest starting time for starting the data migration task. Therefore, in order to take account of the scheduled execution of the data migration task in the following and ensure that the bandwidth available for the service response task exists in the private broadband used by the data migration task, the service response task can be normally executed, and the control time for executing the data migration task may be a specified time belonging to a time period between the earliest starting time and the latest starting time of the data migration task. Thus, the first bandwidth occupation amount of the data migration task at the specified time for the private line broadband to be utilized can be determined, so as to subsequently determine whether to stop executing the data migration task at the specified time in step S104.
The determination manner of the first bandwidth occupation amount may be various. For example, in a complete execution process of any data migration task, the bandwidth occupation amount at any time is the same, so if the data migration task is already started, the bandwidth occupation amount of the data migration task can be collected in real time to serve as the bandwidth occupation amount at a specified time. Or, for example, since the bandwidth occupation amount is likely to have a certain rule in different execution processes of the same data migration, the first bandwidth occupation amount may be predicted by using the second time sequence prediction model based on a second historical bandwidth occupation amount of the data migration task before the earliest starting time. For ease of understanding and reasonable layout, the manner in which the first bandwidth occupancy is determined is described in detail below in the form of alternative embodiments.
Any manner capable of determining the first bandwidth occupancy may be used in the present invention, and the present embodiment is not limited thereto.
And S102, determining a service response task utilizing the private line broadband.
Specifically, the task of determining the response of the service using the private line broadband may be various. The service response task submitted by the operation and maintenance personnel may be received, or the service response task corresponding to the private line broadband to be utilized may be searched from a correspondence between the pre-stored private line broadband and the service response task.
And S103, predicting the bandwidth occupation of the service response task on the private line broadband at the appointed time to obtain a second bandwidth occupation.
In specific application, the bandwidth occupation amount of the service response task on the dedicated line broadband at the specified time is predicted to obtain a second bandwidth occupation amount, specifically, the bandwidth occupation amount of the service response task on the dedicated line broadband at the specified time is predicted by using a first time sequence prediction model obtained by pre-training based on the first historical bandwidth occupation amount of the service response task on the dedicated line broadband at a plurality of continuous first historical times to obtain the second bandwidth occupation amount; any one first historical moment is before a designated moment, and a designated time step is arranged between adjacent first historical moments; the first time sequence prediction model is a model which is obtained based on training of a first training sample set and used for predicting bandwidth occupation, the first training sample set comprises a first sample sequence, the first sample sequence comprises first sample bandwidth occupation of a service response task on a plurality of continuous first sample moments of the special bandwidth, and a time step is specified between adjacent first sample moments.
This is described in detail later in the embodiment of fig. 2 of the present invention for ease of understanding and reasonable layout.
And S104, when the sum of the first bandwidth occupation amount and the second bandwidth occupation amount meets the flow control condition corresponding to the preset private line broadband, stopping executing the data migration task at the specified time.
In an optional implementation manner, the sum of the first bandwidth occupation amount and the second bandwidth occupation amount meets the flow control condition corresponding to the dedicated line broadband, and specifically may include:
and the sum of the first bandwidth occupation amount and the second bandwidth occupation amount is greater than the bandwidth safety threshold corresponding to the special line bandwidth.
Illustratively, when the predicted 10:00 of the specified time 3, month and 2 days in 3, month and 1 days, the second bandwidth occupation amount of a service response task, such as a video playing task, on a special line broadband from Shanghai xx machine room to Beijing xx machine room is 800 mb/s. The total available bandwidth of the special line broadband from Shanghai xx machine room to Beijing xx machine room is 2000mb/s, and the bandwidth safety line is 90 percent, namely the bandwidth safety threshold is 1800 mb/s. When the sum of the first bandwidth occupation amount of the data migration task and the second bandwidth occupation amount of the service response task is larger than 1800mb/s, for example, 1200mb/s +800mb/s is 2000mb/s > 1800mb/s, it indicates that the sum of the first bandwidth occupation amount and the second bandwidth occupation amount meets the flow control condition corresponding to the predetermined private line broadband. Thus, the execution of the data migration task may be stopped at 10:00 on day 3, month 2 at the specified time.
Also, the manner in which the execution of the data migration task is stopped at a specified timing may be various corresponding to different start states of the data migration task. The following detailed description is presented in the form of an alternative embodiment for reasons of clarity and understanding.
In the scheme provided by the invention, after the management platform of the data migration task obtains the data migration task, the first bandwidth occupation amount of the data migration task at the appointed time for the special line broadband to be utilized is determined, and the service response task utilizing the special line broadband is determined; the bandwidth occupation amount of the service response task on the private line broadband at the appointed time is predicted to obtain a second bandwidth occupation amount, and therefore when the sum of the first bandwidth occupation amount and the second bandwidth occupation amount meets the flow control condition corresponding to the preset private line bandwidth, the data migration task is stopped at the appointed time; the specified time belongs to a time period between the earliest start time and the latest start time of the data migration task. Therefore, the execution of the data migration task is stopped at the designated time, the scheduled execution of the data migration task can be considered, the bandwidth which can be used by the service response task exists in the private line broadband used by the data migration task, and the service response task can be normally executed, so that the execution abnormity of the service response task which uses the same private line broadband as the data migration task is reduced.
In an optional implementation manner, the determining that the data migration task occupies the first bandwidth at the specified time by using the private line broadband specifically includes the following steps:
if the data migration task is started, acquiring the bandwidth occupation amount of the data migration task on the special line broadband by using a specified interface as the first bandwidth occupation amount of the data migration task on the special line broadband to be utilized at a specified time; the specified interface is an interface used for recording the bandwidth occupation amount in a module executing a data migration task;
correspondingly, the stopping of the execution of the data migration task at the specified time may specifically include the following steps:
and stopping data migration performed for the data migration task at a specified time.
Illustratively, when the management platform of the data migration task is MapReduce, the specified Interface may be an API (Application Programming Interface) provided by an official authority of MapReduce and used for acquiring traffic, and acquire a bandwidth occupation amount of the data migration task at the current time, as a first bandwidth occupation amount of the data migration task at the specified time for a private line broadband to be utilized. The MapReduce is a high-performance cluster-based parallel computing platform and is used for parallel operation of large-scale data sets (larger than 1 TB). Further, since the data migration task is already started at this time, stopping executing the data migration task at the specified time is specifically stopping data migration performed for the data migration task at the specified time.
In the optional embodiment, the designated interface is used for acquiring the real bandwidth occupation amount of the data migration task to the special line broadband to be utilized in real time, so that the accuracy of judging whether to stop executing the task is improved when the data migration task is managed subsequently.
In another optional implementation, the determining that the data migration task occupies the first bandwidth at the specified time with respect to the dedicated line bandwidth to be utilized specifically includes the following steps:
if the data migration task is not started, predicting to obtain first bandwidth occupation of the data migration task at a specified time by using a second time sequence prediction model obtained by pre-training on the basis of second historical bandwidth occupation of the data migration task at a plurality of continuous second historical times to be used by the private line broadband; any second historical moment is before the earliest starting moment, and the interval between adjacent second historical moments specifies the time step;
the second time sequence prediction model is a model which is obtained based on a second training sample set through training and is used for predicting bandwidth occupation, the second training sample set comprises a second sample sequence, the second sample sequence comprises second sample bandwidth occupation of a data migration task on a plurality of continuous second sample moments of the special bandwidth to be utilized, and the time step length of the second sample time interval is specified;
correspondingly, the stopping of the execution of the data migration task at the specified time may specifically include the following steps:
if the data migration task is not started at the designated moment, stopping starting the data migration task at the designated moment;
and if the data migration task is started at the specified time, stopping the data migration performed aiming at the data migration task at the specified time.
In a specific application, since the designated time belongs to a time period between the earliest starting time and the latest starting time of the data migration task, the data migration task is started or not started at the designated time. For this reason, if the data migration task is not started at the specified time, the data migration task may be stopped at the specified time; if the data migration task has been started at the specified time, the data migration for the data migration task may be stopped at the specified time. For the situation of not starting, the optional embodiment obtains the first bandwidth occupation amount before the data migration task is started by predicting, and compared with obtaining the first bandwidth occupation amount by real-time acquisition, resource waste caused by stopping data migration after the data migration task is started can be reduced.
And similar to the second bandwidth occupation amount obtained through prediction, the first bandwidth occupation amount of the data migration task at the specified time can be obtained through prediction by using a second time sequence prediction model obtained through pre-training for the second historical bandwidth occupation amount of the dedicated line broadband to be used at a plurality of continuous second historical times based on the data migration task. The second timing prediction model is similar to the first timing prediction model, and the difference between the second timing prediction model and the first timing prediction model lies in that the training sets of the samples used in the training process are different, and the same parts are not described herein again, which is described in detail in the following description of the embodiment and the optional embodiment of fig. 2 of the present invention. In addition, the second sample bandwidth occupation amount of the continuous second sample time is the bandwidth occupation amount obtained by the appointed interface.
As shown in fig. 2, a flow of a management method for data migration according to another embodiment of the present invention may include:
s201, after the data migration task is obtained, the first bandwidth occupation amount of the data migration task at the appointed time for the to-be-utilized private line broadband is determined. Wherein the specified time belongs to a time period between the earliest starting time and the latest starting time of the data migration task.
And S202, determining a service response task utilizing the private line broadband.
The above-mentioned steps S201 to S202 are the same as the steps S101 to S102 in the embodiment of fig. 1 of the present invention, and are not repeated herein, for details, see the description of the embodiment of fig. 1 of the present invention.
S203, based on the first historical bandwidth occupation amount of the service response task on the special line broadband at a plurality of continuous first historical moments, predicting the bandwidth occupation amount of the service response task on the special line broadband at the specified moment by using a first time sequence prediction model obtained by pre-training to obtain a second bandwidth occupation amount;
any one first historical moment is before a designated moment, and a designated time step is arranged between adjacent first historical moments; the first time sequence prediction model is a model which is obtained based on training of a first training sample set and used for predicting bandwidth occupation, the first training sample set comprises a first sample sequence, the first sample sequence comprises first sample bandwidth occupation of a service response task on a plurality of continuous first sample moments of the special bandwidth, and a time step is specified between adjacent first sample moments.
In an alternative embodiment, the plurality of first sample bandwidth occupancy is obtained by the following steps:
and aiming at each first sample moment, searching the historical bandwidth occupation quantity which occupies the first sample moment and occupies the private line broadband from a plurality of pre-stored historical bandwidth occupation quantities aiming at the service response task to obtain a plurality of first sample bandwidth occupation quantities.
In a specific application, the pre-storing manner of the plurality of historical bandwidth occupation amounts may include the following steps:
acquiring the bandwidth occupation amount of the service response task on each special line broadband at each occupation moment;
and correspondingly storing the identification records of each occupied time and each private line broadband and the acquired bandwidth occupation amount to obtain the pre-stored historical bandwidth occupation amount.
For example, at each occupation time, the bandwidth occupation amount of each dedicated line broadband at each occupation time by the service response task can be acquired, and the occupation times, the identification records of each dedicated line broadband and the acquired bandwidth occupation amount are correspondingly stored, so that the pre-stored historical bandwidth occupation amount in the form of < current time, source machine room, target machine room and outlet flow > "is obtained. Wherein, the source machine room and the target machine room form the identification of the special line broadband. In addition, the historical bandwidth occupancy can be stored in any database, wherein if the database is an analytical database, such as a Druid database, it is more efficient to subsequently find the first plurality of samples from the pre-stored historical bandwidth occupancy. For example, the pre-stored historical bandwidth occupancy includes:
< time (aggregation in minutes), Source Room, target Room, Outlet flow summation >
< 2019/10/0810: 00, Shanghai xx machine room, Beijing xx machine room, 800mb/s >
< 2019/10/0810: 00, 'Shanghai xx machine room', 'Chongqing xx machine room', 700mb/s >
< 2019/10/0810: 01, "Shanghai xx machine room", "Beijing xx machine room", 600mb/s >
< 2019/10/0810: 01, "Shanghai xx machine room", "Chongqing xx machine room", 500mb/s >
Based on the method, the bandwidth occupation of any two machine rooms in any period of time, namely any one private line broadband, can be inquired. And, when the historical bandwidth occupation amount is recorded by the aggregation of minutes, and the specified time step of the first sample time is one hour, such as 2019/10/0810: 00-2019/10/0911: 00, the queried historical bandwidth occupation amount can be averaged: sum of egress traffic ÷ query time. When the first sample time is the same as the occupation time of the historical bandwidth occupation amount, the inquired historical bandwidth occupation amount can be directly used as the first sample bandwidth occupation amount. Similarly, a second sample bandwidth occupancy may be obtained in the same manner, except that the bandwidth occupancy task is a data migration task.
The first timing prediction model may specifically be a first equation:
wherein, YtIs the second bandwidth occupation at the time t, mu is a constant term,
is an autoregressive accumulated value and is used for describing a first historical bandwidth occupation amount y at the time t-i which is separated from the time t by i time stepst-iAnd a second bandwidth occupation at time t, p being the hysteresis of the first historical bandwidth occupation, gammaiIs the autocorrelation coefficient, epsilontThe error term of the autoregressive cumulative value corresponding to the time t,
for moving the mean accumulated value, for accumulating the error terms of the autoregressive accumulated value, q being the lag number of the error term, θiIs a moving average coefficient; wherein, γi、εtAnd thetaiThe parameters obtained for training.
And S204, when the sum of the first bandwidth occupation amount and the second bandwidth occupation amount meets the flow control condition corresponding to the preset private line broadband, stopping executing the data migration task at the specified time.
The step S204 is the same as the step S104 in the embodiment of fig. 1, and is not repeated herein, for details, see the description of the embodiment of fig. 1.
For ease of understanding, the following description will be made in the form of an exemplary description of a process of determining whether to stop executing a data migration task from acquisition of a training sample set. As shown in fig. 3, since the service response task is executed by the execution cluster, when the server in the execution cluster executes the service response task, bandwidth occupation amounts of the server in the execution cluster on the dedicated line broadband are collected in advance, a plurality of historical bandwidth occupation amounts are obtained and stored, and a training sample set is obtained from the plurality of prestored historical bandwidth occupation amounts. On the basis, a first time sequence prediction model can be obtained by training with a training sample set, and the first time sequence prediction model is provided for the data migration task management platform to use. When the data migration task management platform receives a data migration task submitted by operation and maintenance personnel, a first bandwidth occupation amount of the data migration task can be determined, and a second bandwidth occupation amount is obtained by utilizing a first time sequence prediction model; and judging whether to stop executing the data migration task or not by utilizing the first bandwidth occupation amount and the second bandwidth occupation amount.
Corresponding to the above method embodiment, an embodiment of the present invention further provides a management apparatus for data migration.
As shown in fig. 4, a management apparatus for data migration according to an embodiment of the present invention is applied to a management platform for a data migration task, and the apparatus may include:
the first bandwidth occupation amount determining module 401 is configured to determine, after obtaining the data migration task, an occupation amount of the data migration task for a first bandwidth to be used by the dedicated line broadband at a specified time; the specified time belongs to a time period between the earliest starting time and the latest starting time of the data migration task;
a second bandwidth occupation prediction module 402, configured to determine a service response task using the private line broadband; predicting the bandwidth occupation amount of the service response task on the private line broadband at the specified time to obtain a second bandwidth occupation amount;
and a flow control module 403, configured to stop executing the data migration task at the specified time when a sum of the first bandwidth occupation amount and the second bandwidth occupation amount meets a predetermined flow control condition corresponding to the dedicated broadband.
In the scheme provided by the invention, after the management platform of the data migration task obtains the data migration task, the first bandwidth occupation amount of the data migration task at the appointed time for the special line broadband to be utilized is determined, and the service response task utilizing the special line broadband is determined; the bandwidth occupation amount of the service response task on the private line broadband at the appointed time is predicted to obtain a second bandwidth occupation amount, and therefore when the sum of the first bandwidth occupation amount and the second bandwidth occupation amount meets the flow control condition corresponding to the preset private line bandwidth, the data migration task is stopped at the appointed time; the specified time belongs to a time period between the earliest start time and the latest start time of the data migration task. Therefore, the execution of the data migration task is stopped at the designated time, the scheduled execution of the data migration task can be considered, the bandwidth which can be used by the service response task exists in the private line broadband used by the data migration task, and the service response task can be normally executed, so that the execution abnormity of the service response task which uses the same private line broadband as the data migration task is reduced.
Optionally, the sum of the first bandwidth occupation amount and the second bandwidth occupation amount meets the flow control condition corresponding to the dedicated broadband, and includes:
and the sum of the first bandwidth occupation amount and the second bandwidth occupation amount is greater than the bandwidth safety threshold corresponding to the private line broadband.
Optionally, the second bandwidth occupation prediction module 402 is specifically configured to:
predicting the bandwidth occupation amount of the special line broadband at the specified time by the service response task by utilizing a first time sequence prediction model obtained by pre-training based on the first historical bandwidth occupation amount of the service response task to the special line broadband at a plurality of continuous first historical times to obtain a second bandwidth occupation amount;
any one first historical time is before the designated time, and a designated time step is arranged between adjacent first historical times;
the first time sequence prediction model is a model which is obtained based on training of a first training sample set and used for predicting bandwidth occupation, the first training sample set comprises a first sample sequence, the first sample sequence comprises first sample bandwidth occupation of the service response task on the special bandwidth at a plurality of continuous first sample moments, and the adjacent first sample moments are separated by the specified time step.
Optionally, the bandwidth occupation of the plurality of first samples is obtained by the following steps:
and aiming at each first sample moment, searching the historical bandwidth occupation quantity which occupies the first sample moment and occupies the private line broadband from a plurality of pre-stored historical bandwidth occupation quantities aiming at the service response task to obtain the plurality of first sample bandwidth occupation quantities.
Optionally, the first bandwidth occupancy determining module 401 is specifically configured to:
if the data migration task is started, acquiring the bandwidth occupation amount of the data migration task on the special line broadband by using a specified interface, and taking the bandwidth occupation amount as the first bandwidth occupation amount of the data migration task on the special line broadband to be utilized at a specified time; the designated interface is an interface used for recording bandwidth occupation in a module for executing the data migration task;
the flow control module 403 is specifically configured to:
and stopping data migration performed for the data migration task at the specified time.
Optionally, the first bandwidth occupancy determining module 401 is specifically configured to:
if the data migration task is not started, predicting to obtain first bandwidth occupation of the data migration task at a specified time by using a second time sequence prediction model obtained by pre-training based on second historical bandwidth occupation of the data migration task at a plurality of continuous second historical times for the special line broadband to be used; any second historical time is before the earliest starting time, and the interval between adjacent second historical times is a specified time step;
the second time sequence prediction model is a model which is obtained based on a second training sample set through training and is used for predicting bandwidth occupation, the second training sample set comprises a second sample sequence, the second sample sequence comprises second sample bandwidth occupation of the data migration task on the to-be-utilized special bandwidth at a plurality of continuous second sample moments, and the time step length of the adjacent second sample moments is specified;
the flow control module 403 is specifically configured to:
if the data migration task is not started at the specified time, stopping starting the data migration task at the specified time;
and if the data migration task is started at the specified time, stopping the data migration performed on the data migration task at the specified time.
Corresponding to the above embodiment, an embodiment of the present invention further provides an electronic device, as shown in fig. 5, where the electronic device may include:
the system comprises a processor 501, a communication interface 502, a memory 503 and a communication bus 504, wherein the processor 501, the communication interface 502 and the memory complete mutual communication through the communication bus 504 through the 503;
a memory 503 for storing a computer program;
the processor 501 is configured to implement the steps of the management method for data migration in any of the embodiments when executing the computer program stored in the memory 503.
In a specific application, the electronic device is a management platform for managing data migration tasks.
In the scheme provided by the invention, after the management platform of the data migration task obtains the data migration task, the first bandwidth occupation amount of the data migration task at the appointed time for the special line broadband to be utilized is determined, and the service response task utilizing the special line broadband is determined; the bandwidth occupation amount of the service response task on the private line broadband at the appointed time is predicted to obtain a second bandwidth occupation amount, and therefore when the sum of the first bandwidth occupation amount and the second bandwidth occupation amount meets the flow control condition corresponding to the preset private line bandwidth, the data migration task is stopped at the appointed time; the specified time belongs to a time period between the earliest start time and the latest start time of the data migration task. Therefore, the execution of the data migration task is stopped at the designated time, the scheduled execution of the data migration task can be considered, the bandwidth which can be used by the service response task exists in the private line broadband used by the data migration task, and the service response task can be normally executed, so that the execution abnormity of the service response task which uses the same private line broadband as the data migration task is reduced.
The Memory may include a RAM (Random Access Memory) or an NVM (Non-Volatile Memory), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the processor.
The Processor may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like; but also a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array) or other Programmable logic device, discrete Gate or transistor logic device, discrete hardware component.
The computer-readable storage medium provided by an embodiment of the present invention is included in an electronic device, and a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the management method for data migration in any of the above embodiments are implemented.
In the scheme provided by the invention, after the management platform of the data migration task obtains the data migration task, the first bandwidth occupation amount of the data migration task at the appointed time for the special line broadband to be utilized is determined, and the service response task utilizing the special line broadband is determined; the bandwidth occupation amount of the service response task on the private line broadband at the appointed time is predicted to obtain a second bandwidth occupation amount, and therefore when the sum of the first bandwidth occupation amount and the second bandwidth occupation amount meets the flow control condition corresponding to the preset private line bandwidth, the data migration task is stopped at the appointed time; the specified time belongs to a time period between the earliest start time and the latest start time of the data migration task. Therefore, the execution of the data migration task is stopped at the designated time, the scheduled execution of the data migration task can be considered, the bandwidth which can be used by the service response task exists in the private line broadband used by the data migration task, and the service response task can be normally executed, so that the execution abnormity of the service response task which uses the same private line broadband as the data migration task is reduced.
In yet another embodiment, a computer program product containing instructions is provided, which when executed on a computer, causes the computer to execute the management method for data migration described in any of the above embodiments.
In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the invention to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website, computer, server, or data center to another website, computer, server, or data center via wire (e.g., coaxial cable, fiber optics, DSL (Digital Subscriber Line), or wireless (e.g., infrared, radio, microwave, etc.), the computer readable storage medium may be any available medium that can be accessed by a computer or a data storage cluster including one or more integrated servers, data centers, etc. the available medium may be magnetic medium (e.g., floppy disk, hard disk, magnetic tape), optical medium (e.g., DVD (Digital Versatile Disc, digital versatile disc)), or a semiconductor medium (e.g.: SSD (Solid state disk)), etc.
In this document, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, as for the embodiments of the management device and the electronic device for data migration, since they are basically similar to the embodiments of the method, the description is relatively simple, and for the relevant points, reference may be made to the partial description of the embodiments of the method.
The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.
Claims (14)
1. A management method for data migration is characterized in that the method is applied to a management platform of a data migration task, and comprises the following steps:
after a data migration task is obtained, determining the first bandwidth occupation amount of the data migration task at a specified time for a special line broadband to be utilized; the specified time belongs to a time period between the earliest starting time and the latest starting time of the data migration task;
determining a service response task utilizing the private line broadband;
predicting the bandwidth occupation amount of the service response task on the private line broadband at the specified time to obtain a second bandwidth occupation amount;
and when the sum of the first bandwidth occupation amount and the second bandwidth occupation amount meets the preset flow control condition corresponding to the private line broadband, stopping executing the data migration task at the specified time.
2. The method of claim 1, wherein the sum of the first bandwidth occupation and the second bandwidth occupation meets the flow control condition corresponding to the dedicated line broadband, and comprises:
and the sum of the first bandwidth occupation amount and the second bandwidth occupation amount is greater than the bandwidth safety threshold corresponding to the private line broadband.
3. The method according to claim 1 or 2, wherein the predicting the bandwidth occupation of the service response task at the specified time for the private line broadband to obtain a second bandwidth occupation comprises:
predicting the bandwidth occupation amount of the special line broadband at the specified time by the service response task by utilizing a first time sequence prediction model obtained by pre-training based on the first historical bandwidth occupation amount of the service response task to the special line broadband at a plurality of continuous first historical times to obtain a second bandwidth occupation amount;
any one first historical time is before the designated time, and a designated time step is arranged between adjacent first historical times;
the first time sequence prediction model is a model which is obtained based on training of a first training sample set and used for predicting bandwidth occupation, the first training sample set comprises a first sample sequence, the first sample sequence comprises first sample bandwidth occupation of the service response task on the special bandwidth at a plurality of continuous first sample moments, and the adjacent first sample moments are separated by the specified time step.
4. The method of claim 3, wherein the plurality of first sample bandwidth footprints are obtained by:
and aiming at each first sample moment, searching the historical bandwidth occupation quantity which occupies the first sample moment and occupies the private line broadband from a plurality of pre-stored historical bandwidth occupation quantities aiming at the service response task to obtain the plurality of first sample bandwidth occupation quantities.
5. The method according to claim 1 or 2, wherein the determining of the first bandwidth occupancy of the data migration task at a specified time for the private line broadband to be utilized comprises:
if the data migration task is started, acquiring the bandwidth occupation amount of the data migration task on the special line broadband by using a specified interface, and taking the bandwidth occupation amount as the first bandwidth occupation amount of the data migration task on the special line broadband to be utilized at a specified time; the designated interface is an interface used for recording bandwidth occupation in a module for executing the data migration task;
the stopping of the execution of the data migration task at the specified time includes:
and stopping data migration performed for the data migration task at the specified time.
6. The method according to claim 1 or 2, wherein the determining of the first bandwidth occupancy of the data migration task at a specified time for the private line broadband to be utilized comprises:
if the data migration task is not started, predicting to obtain first bandwidth occupation of the data migration task at a specified time by using a second time sequence prediction model obtained by pre-training based on second historical bandwidth occupation of the data migration task at a plurality of continuous second historical times for the special line broadband to be used; any second historical time is before the earliest starting time, and the interval between adjacent second historical times is a specified time step;
the second time sequence prediction model is a model which is obtained based on a second training sample set through training and is used for predicting bandwidth occupation, the second training sample set comprises a second sample sequence, the second sample sequence comprises second sample bandwidth occupation of the data migration task on the to-be-utilized special bandwidth at a plurality of continuous second sample moments, and the time step length of the adjacent second sample moments is specified;
the stopping of the execution of the data migration task at the specified time includes:
if the data migration task is not started at the specified time, stopping starting the data migration task at the specified time;
and if the data migration task is started at the specified time, stopping the data migration performed on the data migration task at the specified time.
7. A management apparatus for data migration, which is applied to a management platform for data migration tasks, the apparatus comprising:
the first bandwidth occupation amount determining module is used for determining the first bandwidth occupation amount of the data migration task at a specified time for the to-be-utilized private line broadband after the data migration task is obtained; the specified time belongs to a time period between the earliest starting time and the latest starting time of the data migration task;
the second bandwidth occupation prediction module is used for determining a service response task utilizing the private line broadband; predicting the bandwidth occupation amount of the service response task on the private line broadband at the specified time to obtain a second bandwidth occupation amount;
and the flow control module is used for stopping executing the data migration task at the specified time when the sum of the first bandwidth occupation amount and the second bandwidth occupation amount meets the flow control condition corresponding to the preset private line broadband.
8. The apparatus of claim 7, wherein the sum of the first bandwidth occupation and the second bandwidth occupation meets the flow control condition corresponding to the dedicated line broadband, and comprises:
and the sum of the first bandwidth occupation amount and the second bandwidth occupation amount is greater than the bandwidth safety threshold corresponding to the private line broadband.
9. The apparatus according to claim 7 or 8, wherein the second bandwidth occupancy prediction module is specifically configured to:
predicting the bandwidth occupation amount of the special line broadband at the specified time by the service response task by utilizing a first time sequence prediction model obtained by pre-training based on the first historical bandwidth occupation amount of the service response task to the special line broadband at a plurality of continuous first historical times to obtain a second bandwidth occupation amount;
any one first historical time is before the designated time, and a designated time step is arranged between adjacent first historical times;
the first time sequence prediction model is a model which is obtained based on training of a first training sample set and used for predicting bandwidth occupation, the first training sample set comprises a first sample sequence, the first sample sequence comprises first sample bandwidth occupation of the service response task on the special bandwidth at a plurality of continuous first sample moments, and the adjacent first sample moments are separated by the specified time step.
10. The apparatus of claim 9, wherein the plurality of first sample bandwidth footprints are obtained by:
and aiming at each first sample moment, searching the historical bandwidth occupation quantity which occupies the first sample moment and occupies the private line broadband from a plurality of pre-stored historical bandwidth occupation quantities aiming at the service response task to obtain the plurality of first sample bandwidth occupation quantities.
11. The apparatus according to claim 7 or 8, wherein the first bandwidth occupancy determination module is specifically configured to:
if the data migration task is started, acquiring the bandwidth occupation amount of the data migration task on the special line broadband by using a specified interface, and taking the bandwidth occupation amount as the first bandwidth occupation amount of the data migration task on the special line broadband to be utilized at a specified time; the designated interface is an interface used for recording bandwidth occupation in a module for executing the data migration task;
the flow control module is specifically configured to:
and stopping data migration performed for the data migration task at the specified time.
12. The apparatus according to claim 7 or 8, wherein the first bandwidth occupancy determination module is specifically configured to:
if the data migration task is not started, predicting to obtain first bandwidth occupation of the data migration task at a specified time by using a second time sequence prediction model obtained by pre-training based on second historical bandwidth occupation of the data migration task at a plurality of continuous second historical times for the special line broadband to be used; any second historical time is before the earliest starting time, and the interval between adjacent second historical times is a specified time step;
the second time sequence prediction model is a model which is obtained based on a second training sample set through training and is used for predicting bandwidth occupation, the second training sample set comprises a second sample sequence, the second sample sequence comprises second sample bandwidth occupation of the data migration task on the to-be-utilized special bandwidth at a plurality of continuous second sample moments, and the time step length of the adjacent second sample moments is specified;
the flow control module is specifically configured to:
if the data migration task is not started at the specified time, stopping starting the data migration task at the specified time;
and if the data migration task is started at the specified time, stopping the data migration performed on the data migration task at the specified time.
13. An electronic device is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor and the communication interface are used for realizing the communication between the processor and the memory through the bus; a memory for storing a computer program; a processor for executing a program stored on a memory to perform the method steps of any of claims 1-6.
14. A computer-readable storage medium, characterized in that a computer program is stored in the storage medium, which computer program, when being executed by a processor, carries out the method steps of any one of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010224116.9A CN111274230B (en) | 2020-03-26 | 2020-03-26 | Data migration management method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010224116.9A CN111274230B (en) | 2020-03-26 | 2020-03-26 | Data migration management method, device, equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111274230A true CN111274230A (en) | 2020-06-12 |
| CN111274230B CN111274230B (en) | 2024-03-08 |
Family
ID=71002725
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010224116.9A Active CN111274230B (en) | 2020-03-26 | 2020-03-26 | Data migration management method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111274230B (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150095909A1 (en) * | 2013-09-27 | 2015-04-02 | International Business Machines Corporation | Setting retransmission time of an application client during virtual machine migration |
| US20150200833A1 (en) * | 2014-01-10 | 2015-07-16 | Seagate Technology Llc | Adaptive Data Migration Using Available System Bandwidth |
| US20150331715A1 (en) * | 2014-05-19 | 2015-11-19 | Krishnamu Jambur Sathyanarayana | Reliable and deterministic live migration of virtual machines |
| CN106528270A (en) * | 2016-11-16 | 2017-03-22 | 航天信息股份有限公司 | Automatic migration method and system of virtual machine based on OpenStack cloud platform |
| WO2018177107A1 (en) * | 2017-03-29 | 2018-10-04 | 腾讯科技（深圳）有限公司 | Data migration method, migration server, and storage medium |
| CN108900358A (en) * | 2018-08-01 | 2018-11-27 | 重庆邮电大学 | Virtual network function dynamic migration method based on deepness belief network resource requirement prediction |
| US20190026290A1 (en) * | 2016-03-22 | 2019-01-24 | Alibaba Group Holding Limited | Optimization method, evaluation method, and processing method and apparatuses for data migration |
-
2020
- 2020-03-26 CN CN202010224116.9A patent/CN111274230B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150095909A1 (en) * | 2013-09-27 | 2015-04-02 | International Business Machines Corporation | Setting retransmission time of an application client during virtual machine migration |
| US20150200833A1 (en) * | 2014-01-10 | 2015-07-16 | Seagate Technology Llc | Adaptive Data Migration Using Available System Bandwidth |
| US20150331715A1 (en) * | 2014-05-19 | 2015-11-19 | Krishnamu Jambur Sathyanarayana | Reliable and deterministic live migration of virtual machines |
| US20190026290A1 (en) * | 2016-03-22 | 2019-01-24 | Alibaba Group Holding Limited | Optimization method, evaluation method, and processing method and apparatuses for data migration |
| CN106528270A (en) * | 2016-11-16 | 2017-03-22 | 航天信息股份有限公司 | Automatic migration method and system of virtual machine based on OpenStack cloud platform |
| WO2018177107A1 (en) * | 2017-03-29 | 2018-10-04 | 腾讯科技（深圳）有限公司 | Data migration method, migration server, and storage medium |
| CN108664496A (en) * | 2017-03-29 | 2018-10-16 | 腾讯科技（深圳）有限公司 | Data migration method and device |
| CN108900358A (en) * | 2018-08-01 | 2018-11-27 | 重庆邮电大学 | Virtual network function dynamic migration method based on deepness belief network resource requirement prediction |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111274230B (en) | 2024-03-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20230036627A1 (en) | Methods and systems for the reservation and registration of internet of things device licenses | |
| US9652538B2 (en) | Web crawler optimization system | |
| US9934368B2 (en) | User-generated content permissions status analysis system and method | |
| US20170357735A1 (en) | Information presentation method, device, and system | |
| CN108173905B (en) | Resource allocation method and device and electronic equipment | |
| US9189738B2 (en) | Automatic event analysis | |
| CN108243032B (en) | Method, device and equipment for acquiring service level information | |
| CN108366012B (en) | Social relationship establishing method and device and electronic equipment | |
| CN108762885B (en) | Virtual machine creating method and device, management equipment and terminal equipment | |
| CN113591068B (en) | Online login device management method and device and electronic device | |
| CN112506619A (en) | Job processing method, apparatus, electronic device, storage medium, and program product | |
| CN111427628A (en) | Software function module configuration method, device, software product and storage medium | |
| CN111177513A (en) | Method and device for determining abnormal access address, electronic equipment and storage medium | |
| US8521719B1 (en) | Searchable and size-constrained local log repositories for tracking visitors' access to web content | |
| CN114153609A (en) | Resource control method and device, electronic equipment and computer readable storage medium | |
| CN111835536A (en) | Flow prediction method and device | |
| CN117459536A (en) | Resource distribution method, cloud server, device, electronic equipment and storage medium | |
| CN110543509B (en) | Monitoring system, method and device for user access data and electronic equipment | |
| CN111274230A (en) | Data migration management method, device, equipment and storage medium | |
| CN114138499B (en) | GPU resource utilization rate monitoring method and device, computer equipment and medium | |
| CN110708361A (en) | System, method and device for determining grade of digital content publishing user and server | |
| CN115941794A (en) | File storage method, system and device and electronic equipment | |
| CN112491939B (en) | Multimedia resource scheduling method and system | |
| CN111291127B (en) | Data synchronization method, device, server and storage medium | |
| CN114064403A (en) | Task delay analysis processing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |