CN113868218A - Data processing method and device, electronic equipment and computer readable storage medium - Google Patents

Data processing method and device, electronic equipment and computer readable storage medium Download PDF

Info

Publication number
CN113868218A
CN113868218A CN202010623859.3A CN202010623859A CN113868218A CN 113868218 A CN113868218 A CN 113868218A CN 202010623859 A CN202010623859 A CN 202010623859A CN 113868218 A CN113868218 A CN 113868218A
Authority
CN
China
Prior art keywords
migration
target
data
address information
source
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010623859.3A
Other languages
Chinese (zh)
Inventor
周磊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alibaba Group Holding Ltd
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Priority to CN202010623859.3A priority Critical patent/CN113868218A/en
Publication of CN113868218A publication Critical patent/CN113868218A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/18File system types
    • G06F16/185Hierarchical storage management [HSM] systems, e.g. file migration or policies thereof
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21Design, administration or maintenance of databases
    • G06F16/215Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/33Querying
    • G06F16/332Query formulation
    • G06F16/3329Natural language query formulation or dialogue systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Mathematical Physics (AREA)
  • Quality & Reliability (AREA)
  • Artificial Intelligence (AREA)
  • Human Computer Interaction (AREA)
  • Computational Linguistics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The embodiment of the disclosure discloses a data processing method, a data processing device, an electronic device and a computer readable storage medium, wherein the method comprises the following steps: in response to receiving the data migration command, acquiring target migration object data of a migration source; acquiring address information of the migration source; and sending the target migration object data and the address information of the migration source to a migration destination so that the target migration object takes the address information of the migration source as the source address information of the target migration object when sending a message at the migration destination. The technical scheme can not only ensure that most of data to be migrated is insensitive to users under the condition of effective migration, but also meet the requirement of seamless migration of users for objects such as processes to be migrated, programs and the like which depend on connection states and source address information, so that the data service quality can be effectively improved.

Description

Data processing method and device, electronic equipment and computer readable storage medium
Technical Field
The embodiment of the disclosure relates to the technical field of data processing, in particular to a data processing method and device, electronic equipment and a computer-readable storage medium.
Background
With the development of scientific technology and data technology, the application of cloud service technology is more and more extensive. Cloud service providers usually operate massive software and hardware infrastructures, and as online and offline maintenance of equipment, scheduling of resources, and moving of stocks and the like occur more and more frequently, how to reduce data interruption or response time as much as possible during operation and maintenance operations to enable data to be transferred smoothly and reduce the influence of data transfer on users as much as possible, even achieve the imperceptibility of users is a crucial problem for cloud service providers. In the prior art, data migration is usually performed by adopting a hot migration technology, which is effective for most of data to be migrated and basically can achieve user imperceptibility, but for objects such as processes to be migrated, programs and the like depending on connection states and source address information, the requirement of seamless migration is usually not met, which is not favorable for improving data service quality.
Disclosure of Invention
The embodiment of the disclosure provides a data processing method and device, electronic equipment and a computer-readable storage medium.
In a first aspect, an embodiment of the present disclosure provides a data processing method.
Specifically, the data processing method includes:
in response to receiving the data migration command, acquiring target migration object data of a migration source;
acquiring address information of the migration source;
and sending the target migration object data and the address information of the migration source to a migration destination so that the target migration object takes the address information of the migration source as the source address information of the target migration object when sending a message at the migration destination.
With reference to the first aspect, in a first implementation manner of the first aspect, after the obtaining, in response to receiving the data migration command, target migration object data of the migration source, the embodiment of the present disclosure further includes:
and storing the target migration object data into a target migration object file by calling an interface of data exchange equipment.
With reference to the first aspect and the first implementation manner of the first aspect, in a second implementation manner of the first aspect, the sending the target migration object data and the address information of the migration source to the migration destination is implemented as:
sending the target migration object data and the address information of the migration source to a migration destination; or,
and writing the address information of the migration source into the target migration object file, and sending the target migration object file to a migration destination.
With reference to the first aspect, the first implementation manner of the first aspect, and the second implementation manner of the first aspect, in a third implementation manner of the first aspect, the target migration object file is a memory file;
the sending of the target migration object data and the address information of the migration source to the migration destination is implemented as:
and sending the target migration object file and the address information of the migration source to a memory of a migration destination.
With reference to the first aspect, the first implementation manner of the first aspect, the second implementation manner of the first aspect, and the third implementation manner of the first aspect, in a fourth implementation manner of the first aspect, the present disclosure further includes:
and determining data to be migrated, and sending the data to be migrated to the migration destination.
In a second aspect, a data processing method is provided in an embodiment of the present disclosure.
Specifically, the data processing method includes:
in response to receiving the data migration message, acquiring target migration object data and acquiring address information of a migration source;
carrying out migration identification processing on the target migration object data;
and setting the source address information of the target migration object data as the address information of the migration source, and taking the address information of the migration source as the source address information of the target migration object when the target migration object sends a message.
With reference to the second aspect, in a first implementation manner of the second aspect, the obtaining target migration object data in response to receiving the data migration message is implemented as:
and acquiring target migration object data from the received target migration object file by calling an interface of the data exchange equipment in response to the received data migration message.
With reference to the second aspect and the first implementation manner of the second aspect, in a second implementation manner of the second aspect, the obtaining address information of the migration source is implemented as:
receiving address information of the migration source; or,
and analyzing the received target migration object file to obtain the address information of the migration source.
With reference to the second aspect, the first implementation manner of the second aspect, and the second implementation manner of the second aspect, in a third implementation manner of the second aspect, the performing migration identification processing on the target migration object data is implemented as:
and setting hot migration identification information for the target migration object data to indicate that the target migration object data is hot migration data.
In a third aspect, an embodiment of the present disclosure provides a data processing method.
Specifically, the data processing method includes:
the migration source responds to the received data migration command, obtains target migration object data of the migration source and address information of the migration source, and sends the target migration object data and the address information of the migration source to a migration destination;
the migration destination acquires target migration object data and address information of a migration source, performs migration identification processing on the target migration object data, and sets source address information of the target migration object data as the address information of the migration source.
With reference to the third aspect, in a first implementation manner of the third aspect, after the obtaining, in response to receiving the data migration command, the target migration object data of the migration source and the address information of the migration source, the embodiment of the present disclosure further includes:
and storing the target migration object data of the migration source into the target migration object file by calling an interface of the data exchange equipment.
With reference to the third aspect and the first implementation manner of the third aspect, in a second implementation manner of the third aspect, the sending the target migration object data and the address information of the migration source to the migration destination is implemented as:
sending the target migration object data and the address information of the migration source to a migration destination; or,
and writing the address information of the migration source into the target migration object file, and sending the target migration object file to a migration destination.
With reference to the third aspect, the first implementation manner of the third aspect, and the second implementation manner of the third aspect, in a third implementation manner of the third aspect of the present disclosure, the target migration object file is a memory file;
the sending of the target migration object file and the address information of the migration source to the migration destination is implemented as:
and sending the target migration object file and the address information of the migration source to a memory of a migration destination.
With reference to the third aspect, the first implementation manner of the third aspect, the second implementation manner of the third aspect, and the third implementation manner of the third aspect, in a fourth implementation manner of the third aspect, the present disclosure further includes:
and the migration source determines data to be migrated and sends the data to be migrated to the migration destination.
With reference to the third aspect, the first implementation manner of the third aspect, the second implementation manner of the third aspect, the third implementation manner of the third aspect, and the fourth implementation manner of the third aspect, in a fifth implementation manner of the third aspect, the migration destination obtaining target migration object data is implemented as:
and the migration target responds to the received data migration message and acquires target migration object data from the received target migration object file by calling an interface of the data exchange equipment.
With reference to the third aspect, the first implementation manner of the third aspect, the second implementation manner of the third aspect, the third implementation manner of the third aspect, the fourth implementation manner of the third aspect, and the fifth implementation manner of the third aspect, in a sixth implementation manner of the third aspect, the obtaining address information of the migration source is implemented as:
receiving address information of the migration source; or,
and analyzing the received target migration object file to obtain the address information of the migration source.
With reference to the third aspect, the first implementation manner of the third aspect, the second implementation manner of the third aspect, the third implementation manner of the third aspect, the fourth implementation manner of the third aspect, the fifth implementation manner of the third aspect, and the sixth implementation manner of the third aspect, in a seventh implementation manner of the third aspect, the performing migration identification processing on the target migration object data is implemented as:
and setting hot migration identification information for the target migration object data to indicate that the target migration object data is hot migration data.
In a fourth aspect, a data processing apparatus is provided in an embodiment of the present disclosure.
Specifically, the data processing apparatus includes:
the storage module is configured to respond to the received data migration command and acquire target migration object data of the migration source;
a first obtaining module configured to obtain address information of the migration source;
the sending module is configured to send the target migration object data and the address information of the migration source to a migration destination, so that the target migration object takes the address information of the migration source as the source address information of the target migration object when sending a message at the migration destination.
With reference to the fourth aspect, in a first implementation manner of the fourth aspect, the embodiment of the present disclosure further includes, after the storage module:
and the storage module is configured to store the target migration object data into a target migration object file by calling an interface of the data exchange device.
With reference to the fourth aspect and the first implementation manner of the fourth aspect, in a second implementation manner of the fourth aspect, the sending module is configured to:
sending the target migration object file and the address information of the migration source to a migration destination; or,
and writing the address information of the migration source into the target migration object file, and sending the target migration object file to a migration destination.
With reference to the fourth aspect, the first implementation manner of the fourth aspect, and the second implementation manner of the fourth aspect, in a third implementation manner of the fourth aspect, the target migration object file is a memory file;
the sending module is configured to:
and sending the target migration object file and the address information of the migration source to a memory of a migration destination.
With reference to the fourth aspect, the first implementation manner of the fourth aspect, the second implementation manner of the fourth aspect, and the third implementation manner of the fourth aspect, in a fourth implementation manner of the fourth aspect, the present disclosure further includes:
the determining module is configured to determine data to be migrated and send the data to be migrated to the migration destination.
In a fifth aspect, a data processing apparatus is provided in an embodiment of the present disclosure.
Specifically, the data processing apparatus includes:
the second acquisition module is configured to respond to the received data migration message, acquire target migration object data and acquire the address information of the migration source;
the identification module is configured to perform migration identification processing on the target migration object data;
a setting module configured to set the source address information of the target migration object data as the address information of the migration source, so as to use the address information of the migration source as the source address information of the target migration object when the target migration object sends a message.
With reference to the fifth aspect, in a first implementation manner of the fifth aspect, the second obtaining module, in response to receiving the data migration message, is configured to obtain the portion of the target migration object data, and is configured to:
and acquiring target migration object data from the received target migration object file by calling an interface of the data exchange equipment in response to the received data migration message.
With reference to the fifth aspect and the first implementation manner of the fifth aspect, in a second implementation manner of the fifth aspect, the second obtaining module is configured to obtain, by the second obtaining module, the part of the address information of the migration source, configured to:
receiving address information of the migration source; or,
and analyzing the received target migration object file to obtain the address information of the migration source.
With reference to the fifth aspect, the first implementation manner of the fifth aspect, and the second implementation manner of the fifth aspect, in a third implementation manner of the fifth aspect, the identifying module is configured to:
and setting hot migration identification information for the target migration object data to indicate that the target migration object data is hot migration data.
In a sixth aspect, a data processing apparatus is provided in an embodiment of the present disclosure.
Specifically, the data processing apparatus includes:
the migration source is configured to respond to a received data migration command, acquire target migration object data of the migration source and address information of the migration source, and send the target migration object data and the address information of the migration source to a migration destination;
and the migration destination is configured to acquire target migration object data and address information of a migration source, perform migration identification processing on the target migration object data, and set source address information of the target migration object data as address information of the migration source.
With reference to the sixth aspect, in a first implementation manner of the sixth aspect, after the obtaining, in response to receiving the data migration command, the target migration object data of the migration source and the address information of the migration source, the embodiment of the present disclosure is further configured to:
and storing the target migration object data of the migration source into the target migration object file by calling an interface of the data exchange equipment.
With reference to the sixth aspect and the first implementation manner of the sixth aspect, in a second implementation manner of the sixth aspect, the sending the target migration object data and the address information of the migration source to the migration destination part is configured to:
sending the target migration object data and the address information of the migration source to a migration destination; or,
and writing the address information of the migration source into the target migration object file, and sending the target migration object file to a migration destination.
With reference to the sixth aspect, the first implementation manner of the sixth aspect, and the second implementation manner of the sixth aspect, in a third implementation manner of the sixth aspect of the present disclosure, the target migration object file is a memory file;
the part for sending the target migration object file and the address information of the migration source to the migration destination is configured to:
and sending the target migration object file and the address information of the migration source to a memory of a migration destination.
With reference to the sixth aspect, the first implementation manner of the sixth aspect, the second implementation manner of the sixth aspect, and the third implementation manner of the sixth aspect, in a fourth implementation manner of the sixth aspect, the migration source is further configured to:
and determining data to be migrated, and sending the data to be migrated to the migration destination.
With reference to the sixth aspect, the first implementation manner of the sixth aspect, the second implementation manner of the sixth aspect, the third implementation manner of the sixth aspect, and the fourth implementation manner of the sixth aspect, in a fifth implementation manner of the sixth aspect of the present disclosure, the migration destination acquiring portion is configured to:
and the migration target responds to the received data migration message and acquires target migration object data from the received target migration object file by calling an interface of the data exchange equipment.
With reference to the sixth aspect, the first implementation manner of the sixth aspect, the second implementation manner of the sixth aspect, the third implementation manner of the sixth aspect, the fourth implementation manner of the sixth aspect, and the fifth implementation manner of the sixth aspect, in a sixth implementation manner of the sixth aspect of the present disclosure, the portion that acquires address information of the migration source is configured to:
receiving address information of the migration source; or,
and analyzing the received target migration object file to obtain the address information of the migration source.
With reference to the sixth aspect, the first implementation manner of the sixth aspect, the second implementation manner of the sixth aspect, the third implementation manner of the sixth aspect, the fourth implementation manner of the sixth aspect, the fifth implementation manner of the sixth aspect, and the sixth implementation manner of the sixth aspect, in a seventh implementation manner of the sixth aspect, the portion performing migration identification processing on the target migration object data is configured to:
and setting hot migration identification information for the target migration object data to indicate that the target migration object data is hot migration data.
In a seventh aspect, an embodiment of the present disclosure provides an electronic device, including a memory and a processor, where the memory is used to store one or more computer instructions for supporting a data processing apparatus to execute the data processing method, and the processor is configured to execute the computer instructions stored in the memory. The data processing apparatus may further comprise a communication interface for the data processing apparatus to communicate with other devices or a communication network.
In an eighth aspect, the disclosed embodiments provide a computer-readable storage medium for storing computer instructions for a data processing apparatus, which contains computer instructions for executing the data processing method described above as a data processing apparatus.
The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects:
the technical scheme sends the target migration object data to be migrated and the address information of the migration source to the migration destination. The technical scheme can not only ensure that most of data to be migrated is insensitive to users under the condition of effective migration, but also meet the requirement of seamless migration of users for objects such as processes to be migrated, programs and the like which depend on connection states and source address information, so that the data service quality can be effectively improved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of embodiments of the disclosure.
Drawings
Other features, objects, and advantages of embodiments of the disclosure will become more apparent from the following detailed description of non-limiting embodiments when taken in conjunction with the accompanying drawings. In the drawings:
1-3 show flow diagrams of data processing methods according to various embodiments of the present disclosure;
FIG. 4 is a schematic diagram illustrating an application scenario of a data processing method according to an embodiment of the present disclosure;
5-7 show block diagrams of structures of data processing devices according to various embodiments of the present disclosure;
fig. 8 is a schematic block diagram of a computer system suitable for implementing a data processing method according to an embodiment of the present disclosure.
Detailed Description
Hereinafter, exemplary embodiments of the disclosed embodiments will be described in detail with reference to the accompanying drawings so that they can be easily implemented by those skilled in the art. Also, for the sake of clarity, parts not relevant to the description of the exemplary embodiments are omitted in the drawings.
In the disclosed embodiments, it is to be understood that terms such as "including" or "having," etc., are intended to indicate the presence of the disclosed features, numbers, steps, behaviors, components, parts, or combinations thereof, and are not intended to preclude the possibility that one or more other features, numbers, steps, behaviors, components, parts, or combinations thereof may be present or added.
It should be further noted that the embodiments and features of the embodiments in the present disclosure may be combined with each other without conflict. The embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings in conjunction with embodiments.
The technical scheme provided by the embodiment of the disclosure sends the target migration object data to be migrated and the address information of the migration source to the migration destination. The technical scheme can not only ensure that most of data to be migrated is insensitive to users under the condition of effective migration, but also meet the requirement of seamless migration of users for objects such as processes to be migrated, programs and the like which depend on connection states and source address information, so that the data service quality can be effectively improved.
Fig. 1 shows a flowchart of a data processing method according to an embodiment of the present disclosure, which includes the following steps S101 to S103, as shown in fig. 1:
in step S101, in response to receiving a data migration command, target migration object data of a migration source is acquired;
in step S102, address information of the migration source is acquired;
in step S103, the target migration object data and the address information of the migration source are sent to a migration destination, so that the target migration object takes the address information of the migration source as the source address information of the target migration object when sending a message at the migration destination.
As mentioned above, with the development of scientific technology and data technology, the application of cloud service technology is becoming more and more widespread. Cloud service providers usually operate massive software and hardware infrastructures, and as online and offline maintenance of equipment, scheduling of resources, and moving of stocks and the like occur more and more frequently, how to reduce data interruption or response time as much as possible during operation and maintenance operations to enable data to be transferred smoothly and reduce the influence of data transfer on users as much as possible, even achieve the imperceptibility of users is a crucial problem for cloud service providers. In the prior art, data migration is usually performed by adopting a hot migration technology, which is effective for most of data to be migrated and basically can achieve user imperceptibility, but generally does not meet the requirement of seamless migration for objects such as processes to be migrated, programs and the like which depend on connection states and source address information.
In view of the above, in this embodiment, a data processing method is proposed that transmits target migration target data to be migrated to a migration destination together with address information of a migration source. The technical scheme can not only ensure that most of data to be migrated is insensitive to users under the condition of effective migration, but also meet the requirement of seamless migration of users for objects such as processes to be migrated, programs and the like which depend on connection states and source address information, so that the data service quality can be effectively improved.
In an embodiment of the present disclosure, the data processing method is applied to a physical machine, a physical machine loaded with a virtual machine, or a migration source device running one or more processes or programs and capable of performing migration.
In an embodiment of the present disclosure, the data migration command refers to a command for initiating data migration, where the data migration command may be issued by an external controller, may be issued by a device where data to be migrated is located, may be issued by a device that receives the data to be migrated, and may also be issued by another device, and the present disclosure does not specifically limit the departure of the data migration command.
In an embodiment of the present disclosure, the migration source refers to a device where data to be migrated is located, and the migration destination refers to a destination device where the data to be migrated is migrated, for example, if a data migration task needs to migrate a virtual machine from a physical machine a to a physical machine B, the physical machine a is the migration source, and the physical machine B is the migration destination.
In an embodiment of the present disclosure, the target migration object refers to an object such as a process or a program that needs to be migrated, depends on a connection state, and depends on source address information.
In an embodiment of the present disclosure, the target migration object data refers to related data of the target migration object, such as state data of the target migration object, other data capable of supporting normal operation of the target migration object, and the like.
In an embodiment of the present disclosure, the address information of the migration source refers to information for identifying a location of the migration source, for example, if the migration source is a physical machine a, the address information of the migration source may be an IP address of the physical machine a.
In an embodiment of the present disclosure, the target migration object data may be obtained by accessing a log file of the target migration object, and the like.
In an embodiment of the present disclosure, after the step S101, that is, after acquiring the target migration object data of the migration source in response to receiving the data migration command, the method may further include:
and storing the target migration object data into a target migration object file by calling an interface of data exchange equipment.
The data switching device refers to a device for switching or routing data, such as a switch, and in the virtualization technology, may also be a virtual switch.
In an embodiment of the present disclosure, the target migration object file refers to a file for storing the target migration object data, and the target migration object file may be a file newly created for a certain target migration object in response to the data migration command, or a file created in a history, as long as the file can store the target migration object data and uniquely identify the storage content, so as to distinguish and determine the target migration object data and the storage location thereof.
In order to generate a target migration object file capable of storing target migration object data to facilitate migration of data, in this embodiment, the target migration object data of the migration source is stored into the target migration object file by calling an interface of the data exchange device.
In an embodiment of the present disclosure, the step S103, that is, the step of sending the target migration target data and the address information of the migration source to the migration destination, may be implemented as:
sending the target migration object file and the address information of the migration source to a migration destination; or,
and writing the address information of the migration source into the target migration object file, and sending the target migration object file to a migration destination.
In this embodiment, in order to enable the target migration object to use the address information of the migration source as the source address information of the target migration object when sending a message at the migration destination, avoid the situation that the target migration object fails to address or query the object due to the change of the device where the target migration object is located after migration, and enable the target migration object to have the capability of continuous migration, the address information of the migration source and the target migration object file need to be sent to the migration destination together.
If the address information of the migration source and the target migration object file are mutually independent data, the address information of the migration source and the target migration object file can be sent to the migration destination together when the target migration object file is sent.
In addition, the address information of the migration source may be written into the target migration object file in advance, and then the target migration object file may be sent to the migration destination.
In an embodiment of the present disclosure, in order to increase the speed of data uploading and downloading, the target migration object file is a memory file, that is, the target migration object data is stored by a memory, and at this time, the step S103, that is, the step of sending the target migration object data and the address information of the migration source to the migration destination, may be implemented as:
and sending the target migration object file and the address information of the migration source to a memory of a migration destination.
That is to say, in this embodiment, the target migration object file and the address information of the migration source are transferred through the memories of the migration source and the migration destination, that is, the target migration object file and the address information of the migration source are transferred from the memory of the migration source to the memory of the migration destination.
In an embodiment of the present disclosure, the method further comprises the steps of:
and determining data to be migrated, and sending the data to be migrated to the migration destination.
In this embodiment, when there is another data to be migrated, the other data to be migrated is also sent to the migration destination.
Fig. 2 shows a flowchart of a data processing method according to another embodiment of the present disclosure, which includes the following steps S201 to S203, as shown in fig. 2:
in step S201, in response to receiving the data migration message, acquiring target migration object data and acquiring address information of a migration source;
in step S202, migration identification processing is performed on the target migration object data;
in step S203, the source address information of the target migration object data is set as the address information of the migration source, so that the address information of the migration source is used as the source address information of the target migration object when the target migration object sends a message.
As mentioned above, with the development of scientific technology and data technology, the application of cloud service technology is becoming more and more widespread. Cloud service providers usually operate massive software and hardware infrastructures, and as online and offline maintenance of equipment, scheduling of resources, and moving of stocks and the like occur more and more frequently, how to reduce data interruption or response time as much as possible during operation and maintenance operations to enable data to be transferred smoothly and reduce the influence of data transfer on users as much as possible, even achieve the imperceptibility of users is a crucial problem for cloud service providers. In the prior art, data migration is usually performed by adopting a hot migration technology, which is effective for most of data to be migrated and basically can achieve user imperceptibility, but generally does not meet the requirement of seamless migration for objects such as processes to be migrated, programs and the like which depend on connection states and source address information.
In view of the above problem, in this embodiment, a data processing method is proposed, which acquires target migration target data and address information of a migration source, and then sets source address information of the target migration target data as the address information of the migration source, so as to take the address information of the migration source as the source address information of the target migration target when the target migration target sends a message. The technical scheme can not only ensure that most of data to be migrated is insensitive to users under the condition of effective migration, but also meet the requirement of seamless migration of users for objects such as processes to be migrated, programs and the like which depend on connection states and source address information, so that the data service quality can be effectively improved.
In an embodiment of the present disclosure, the data processing method is applied to a physical machine, a physical machine loaded with a virtual machine, or a migration destination device running one or more processes or programs and capable of receiving migration.
In an embodiment of the present disclosure, the migration identification process refers to a process of identifying a migration type to characterize a migration type of migration data, where the migration type may be, for example, a hot migration type, a cold migration type, or the like.
In the foregoing embodiment, after the migration destination obtains the target migration object data and the address information of the migration source, the source address information of the target migration object data may be set as the address information of the migration source, so that when the target migration object sends a message, the address information of the migration source may be used as the source address information of the target migration object, thereby avoiding a situation that the target migration object fails to address or query the object due to a change of a device in which the target migration object is located after migration, and meanwhile, the source address information of the target migration object data is set as the address information of the migration source due to the migration destination, that is, the migration mechanism may be continuously implemented, so that the target migration object has a capability of continuous migration.
In an embodiment of the present disclosure, the step of acquiring target migration object data in response to receiving the data migration message in step S201 may be implemented as:
and acquiring target migration object data from the received target migration object file by calling an interface of the data exchange equipment in response to the received data migration message.
In order to obtain complete and effective target migration object data, the migration of the data is completed, in this embodiment, the target migration object data is obtained from the received target migration object file by calling an interface of the data exchange device.
In an embodiment of the present disclosure, the step of acquiring address information of the migration source in step S201 may be implemented as:
receiving address information of the migration source; or,
and analyzing the received target migration object file to obtain the address information of the migration source.
As mentioned above, if the address information of the migration source and the target migration object file are mutually independent data, the address information of the migration source and the target migration object file may be sent to the migration destination together when the target migration object file is sent, and at this time, the migration destination may directly receive the address information of the migration source.
If the migration source writes the address information of the migration source into the target migration object file in advance and sends the target migration object file to the migration destination, the migration destination can obtain the address information of the migration source by analyzing the received target migration object file.
In an embodiment of the present disclosure, the step S202, that is, the step of performing migration identification processing on the target migration target data, may be implemented as:
and setting hot migration identification information for the target migration object data to indicate that the target migration object data is hot migration data.
In order to clarify the migration type of a certain target migration object data and facilitate subsequent message sending or other migration related processing, in this embodiment, hot migration identification information is further set for the target migration object data, for example, if the migration identification information of a certain target migration object data is the hot migration identification information, the subsequent processing may be preferentially performed.
Technical terms and technical features related to the technical terms and technical features shown in fig. 2 and related embodiments are the same as or similar to those of the technical terms and technical features shown in fig. 1 and related embodiments, and for the explanation and description of the technical terms and technical features related to the technical terms and technical features shown in fig. 2 and related embodiments, reference may be made to the above explanation of the explanation of fig. 1 and related embodiments, and no further description is provided here.
Fig. 3 illustrates a flowchart of a data processing method according to still another embodiment of the present disclosure, which includes the following steps S301 to S302, as illustrated in fig. 3:
in step S301, in response to receiving a data migration command, a migration source acquires target migration object data of the migration source and address information of the migration source, and sends the target migration object data and the address information of the migration source to a migration destination;
in step S302, the migration destination obtains target migration object data and address information of the migration source, performs migration identification processing on the target migration object data, and sets source address information of the target migration object data as address information of the migration source.
As mentioned above, with the development of scientific technology and data technology, the application of cloud service technology is becoming more and more widespread. Cloud service providers usually operate massive software and hardware infrastructures, and as online and offline maintenance of equipment, scheduling of resources, and moving of stocks and the like occur more and more frequently, how to reduce data interruption or response time as much as possible during operation and maintenance operations to enable data to be transferred smoothly and reduce the influence of data transfer on users as much as possible, even achieve the imperceptibility of users is a crucial problem for cloud service providers. In the prior art, data migration is usually performed by adopting a hot migration technology, which is effective for most of data to be migrated and basically can achieve user imperceptibility, but generally does not meet the requirement of seamless migration for objects such as processes to be migrated, programs and the like which depend on connection states and source address information.
In view of the above problem, in this embodiment, a data processing method is provided, in which target migration target data to be migrated and address information of a migration source are sent to a migration destination together, and after the migration destination obtains the target migration target data and the address information of the migration source, the migration destination sets source address information of the target migration target data as the address information of the migration source, so that when the target migration target sends a message, the address information of the migration source is used as the source address information of the target migration target. The technical scheme can not only ensure that most of data to be migrated is insensitive to users under the condition of effective migration, but also meet the requirement of seamless migration of users for objects such as processes to be migrated, programs and the like which depend on connection states and source address information, so that the data service quality can be effectively improved.
In an embodiment of the present disclosure, the data processing method is applicable to a system including one or more physical machines, one or more physical machines loaded with a virtual machine, or one or more devices running one or more processes or programs and capable of performing migration.
In an embodiment of the present disclosure, after acquiring target migration object data of a migration source and address information of the migration source in response to receiving a data migration command, the method further includes:
and storing the target migration object data of the migration source into the target migration object file by calling an interface of the data exchange equipment.
In an embodiment of the present disclosure, the sending the target migration object data and the address information of the migration source to the migration destination is implemented as:
sending the target migration object data and the address information of the migration source to a migration destination; or,
and writing the address information of the migration source into the target migration object file, and sending the target migration object file to a migration destination.
In an embodiment of the present disclosure, the target migration object file is a memory file;
the sending of the target migration object file and the address information of the migration source to the migration destination is implemented as:
and sending the target migration object file and the address information of the migration source to a memory of a migration destination.
In an embodiment of the present disclosure, the method further includes:
and the migration source determines data to be migrated and sends the data to be migrated to the migration destination.
In an embodiment of the present disclosure, the obtaining, by the migration destination, target migration object data is implemented as:
and the migration target responds to the received data migration message and acquires target migration object data from the received target migration object file by calling an interface of the data exchange equipment.
In an embodiment of the present disclosure, the obtaining address information of the migration source is implemented as:
receiving address information of the migration source; or,
and analyzing the received target migration object file to obtain the address information of the migration source.
In an embodiment of the present disclosure, the performing migration identification processing on the target migration object data is implemented as:
and setting hot migration identification information for the target migration object data to indicate that the target migration object data is hot migration data.
Technical terms and technical features related to the technical terms and technical features shown in fig. 3 and related embodiments are the same as or similar to those of the technical terms and technical features shown in fig. 1-2 and related embodiments, and for the explanation and description of the technical terms and technical features related to the technical terms and technical features shown in fig. 3 and related embodiments, the above explanation of the embodiment shown in fig. 1-2 and related embodiments can be referred to, and will not be repeated here.
Fig. 4 is a schematic diagram illustrating an application scenario of the data processing method according to an embodiment of the present disclosure, as shown in fig. 4, assuming that a migration source is device a, a migration destination is device B, and a target migration object is a certain session, before migration, when the session sends a message to a load balancer SLB at device a, a source address is an IP address a-IP of device a, and a destination address is an IP address SLB-IP of the load balancer SLB; when the migration is started, the device A stores the session data into a session memory file and sends the session memory file and the IP address A-IP of the device A to the device B; the device B acquires the session data from the received session memory file, acquires the IP address A-IP of the device A, performing migration identification processing on the session data, setting source address information of the session data as an IP address A-IP of the device A, thus, after migration, when the session sends a message to the load balancer SLB at device B, the destination address is still the IP address SLB-IP of the load balancer SLB, and the source address is the IP address a-IP of device a, not the actual source address, i.e., the IP address of the device B, it is possible to avoid the situation that the object addressing or the object query fails due to the change of the device in which the session is located after the migration, meanwhile, the migration mechanism can be continuously implemented, so that the session has the capability of continuous migration.
It should be noted that the above technical solution can be used not only for data live migration in Cloud Service scenarios such as VPC (Virtual Private Cloud) and ECS (Elastic computer Service), but also for data live migration in a database scenario, and other data live migration scenarios capable of implementing migration and target data acquisition based on address information of a migration source.
The following are embodiments of the disclosed apparatus that may be used to perform embodiments of the disclosed methods.
Fig. 5 shows a block diagram of a data processing apparatus according to an embodiment of the present disclosure, which may be implemented as part or all of an electronic device by software, hardware, or a combination of both. As shown in fig. 5, the data processing apparatus includes:
a storage module 501 configured to obtain target migration object data of a migration source in response to receiving a data migration command;
a first obtaining module 502 configured to obtain address information of the migration source;
a sending module 503, configured to send the target migration object data and the address information of the migration source to a migration destination, so that the target migration object takes the address information of the migration source as source address information of the target migration object when sending a message at the migration destination.
As mentioned above, with the development of scientific technology and data technology, the application of cloud service technology is becoming more and more widespread. Cloud service providers usually operate massive software and hardware infrastructures, and as online and offline maintenance of equipment, scheduling of resources, and moving of stocks and the like occur more and more frequently, how to reduce data interruption or response time as much as possible during operation and maintenance operations to enable data to be transferred smoothly and reduce the influence of data transfer on users as much as possible, even achieve the imperceptibility of users is a crucial problem for cloud service providers. In the prior art, data migration is usually performed by adopting a hot migration technology, which is effective for most of data to be migrated and basically can achieve user imperceptibility, but generally does not meet the requirement of seamless migration for objects such as processes to be migrated, programs and the like which depend on connection states and source address information.
In view of the above, in this embodiment, a data processing apparatus is proposed which transmits target migration target data to be migrated to a migration destination together with address information of a migration source. The technical scheme can not only ensure that most of data to be migrated is insensitive to users under the condition of effective migration, but also meet the requirement of seamless migration of users for objects such as processes to be migrated, programs and the like which depend on connection states and source address information, so that the data service quality can be effectively improved.
In an embodiment of the present disclosure, the data processing apparatus may be implemented as a physical machine, a physical machine loaded with a virtual machine, or a migration source device running one or more processes or programs and capable of performing migration.
In an embodiment of the present disclosure, the data migration command refers to a command for initiating data migration, where the data migration command may be issued by an external controller, may be issued by a device where data to be migrated is located, may be issued by a device that receives the data to be migrated, and may also be issued by another device, and the present disclosure does not specifically limit the departure of the data migration command.
In an embodiment of the present disclosure, the migration source refers to a device where data to be migrated is located, and the migration destination refers to a destination device where the data to be migrated is migrated, for example, if a data migration task needs to migrate a virtual machine from a physical machine a to a physical machine B, the physical machine a is the migration source, and the physical machine B is the migration destination.
In an embodiment of the present disclosure, the target migration object refers to an object such as a process or a program that needs to be migrated, depends on a connection state, and depends on source address information.
In an embodiment of the present disclosure, the target migration object data refers to related data of the target migration object, such as state data of the target migration object, other data capable of supporting normal operation of the target migration object, and the like.
In an embodiment of the present disclosure, the address information of the migration source refers to information for identifying a location of the migration source, for example, if the migration source is a physical machine a, the address information of the migration source may be an IP address of the physical machine a.
In an embodiment of the present disclosure, the target migration object data may be obtained by accessing a log file of the target migration object, and the like.
In an embodiment of the present disclosure, the storage module 501 further includes:
and the storage module is configured to store the target migration object data into a target migration object file by calling an interface of the data exchange device.
The data switching device refers to a device for switching or routing data, such as a switch, and in the virtualization technology, may also be a virtual switch.
In an embodiment of the present disclosure, the target migration object file refers to a file for storing the target migration object data, and the target migration object file may be a file newly created for a certain target migration object in response to the data migration command, or a file created in a history, as long as the file can store the target migration object data and uniquely identify the storage content, so as to distinguish and determine the target migration object data and the storage location thereof.
In order to generate a target migration object file capable of storing target migration object data to facilitate migration of data, in this embodiment, the target migration object data of the migration source is stored into the target migration object file by calling an interface of the data exchange device.
In an embodiment of the present disclosure, the sending module 503 may be configured to:
sending the target migration object file and the address information of the migration source to a migration destination; or,
and writing the address information of the migration source into the target migration object file, and sending the target migration object file to a migration destination.
In this embodiment, in order to enable the target migration object to use the address information of the migration source as the source address information of the target migration object when sending a message at the migration destination, avoid the situation that the target migration object fails to address or query the object due to the change of the device where the target migration object is located after migration, and enable the target migration object to have the capability of continuous migration, the address information of the migration source and the target migration object file need to be sent to the migration destination together.
If the address information of the migration source and the target migration object file are mutually independent data, the address information of the migration source and the target migration object file can be sent to the migration destination together when the target migration object file is sent.
In addition, the address information of the migration source may be written into the target migration object file in advance, and then the target migration object file may be sent to the migration destination.
In an embodiment of the present disclosure, in order to increase the speed of data uploading and downloading, the target migration object file is a memory file, that is, the target migration object data is stored by a memory, in this case, the sending module 503 may be configured to:
and sending the target migration object file and the address information of the migration source to a memory of a migration destination.
That is to say, in this embodiment, the target migration object file and the address information of the migration source are transferred through the memories of the migration source and the migration destination, that is, the target migration object file and the address information of the migration source are transferred from the memory of the migration source to the memory of the migration destination.
In an embodiment of the present disclosure, the apparatus further includes:
the determining module is configured to determine data to be migrated and send the data to be migrated to the migration destination.
In this embodiment, when there is another data to be migrated, the other data to be migrated is also sent to the migration destination.
Fig. 6 shows a block diagram of a data processing apparatus according to an embodiment of the present disclosure, which may be implemented as part or all of an electronic device by software, hardware, or a combination of both. As shown in fig. 6, the data processing apparatus includes:
a second obtaining module 601, configured to, in response to receiving the data migration message, obtain target migration object data and obtain address information of a migration source;
an identification module 602 configured to perform migration identification processing on the target migration object data;
a setting module 603 configured to set the source address information of the target migration object data as the address information of the migration source, so as to use the address information of the migration source as the source address information of the target migration object when the target migration object sends a message.
As mentioned above, with the development of scientific technology and data technology, the application of cloud service technology is becoming more and more widespread. Cloud service providers usually operate massive software and hardware infrastructures, and as online and offline maintenance of equipment, scheduling of resources, and moving of stocks and the like occur more and more frequently, how to reduce data interruption or response time as much as possible during operation and maintenance operations to enable data to be transferred smoothly and reduce the influence of data transfer on users as much as possible, even achieve the imperceptibility of users is a crucial problem for cloud service providers. In the prior art, data migration is usually performed by adopting a hot migration technology, which is effective for most of data to be migrated and basically can achieve user imperceptibility, but generally does not meet the requirement of seamless migration for objects such as processes to be migrated, programs and the like which depend on connection states and source address information.
In view of the above problem, in this embodiment, a data processing method is proposed, which acquires target migration target data and address information of a migration source, and then sets source address information of the target migration target data as the address information of the migration source, so as to take the address information of the migration source as the source address information of the target migration target when the target migration target sends a message. The technical scheme can not only ensure that most of data to be migrated is insensitive to users under the condition of effective migration, but also meet the requirement of seamless migration of users for objects such as processes to be migrated, programs and the like which depend on connection states and source address information, so that the data service quality can be effectively improved.
In an embodiment of the present disclosure, the data processing apparatus may be implemented as a physical machine, a physical machine loaded with a virtual machine, or a migration destination device running one or more processes or programs and capable of receiving migration.
In an embodiment of the present disclosure, the migration identification process refers to a process of identifying a migration type to characterize a migration type of migration data, where the migration type may be, for example, a hot migration type, a cold migration type, or the like.
In the foregoing embodiment, after the migration destination obtains the target migration object data and the address information of the migration source, the source address information of the target migration object data may be set as the address information of the migration source, so that when the target migration object sends a message, the address information of the migration source may be used as the source address information of the target migration object, thereby avoiding a situation that the target migration object fails to address or query the object due to a change of a device in which the target migration object is located after migration, and meanwhile, the source address information of the target migration object data is set as the address information of the migration source due to the migration destination, that is, the migration mechanism may be continuously implemented, so that the target migration object has a capability of continuous migration.
In an embodiment of the present disclosure, the second obtaining module 601, in response to receiving the data migration message, obtaining the portion of the target migration object data, may be configured to:
and acquiring target migration object data from the received target migration object file by calling an interface of the data exchange equipment in response to the received data migration message.
In order to obtain complete and effective target migration object data, the migration of the data is completed, in this embodiment, the target migration object data is obtained from the received target migration object file by calling an interface of the data exchange device.
In an embodiment of the present disclosure, the portion of the second obtaining module 601, which obtains the address information of the migration source, may be configured to:
receiving address information of the migration source; or,
and analyzing the received target migration object file to obtain the address information of the migration source.
As mentioned above, if the address information of the migration source and the target migration object file are mutually independent data, the address information of the migration source and the target migration object file may be sent to the migration destination together when the target migration object file is sent, and at this time, the migration destination may directly receive the address information of the migration source.
If the migration source writes the address information of the migration source into the target migration object file in advance and sends the target migration object file to the migration destination, the migration destination can obtain the address information of the migration source by analyzing the received target migration object file.
In an embodiment of the present disclosure, the identification module 602 may be configured to:
and setting hot migration identification information for the target migration object data to indicate that the target migration object data is hot migration data.
In order to clarify the migration type of a certain target migration object data and facilitate subsequent message sending or other migration related processing, in this embodiment, hot migration identification information is further set for the target migration object data, for example, if the migration identification information of a certain target migration object data is the hot migration identification information, the subsequent processing may be preferentially performed.
Technical terms and technical features related to the technical terms and technical features shown in fig. 6 and related embodiments are the same as or similar to those of the technical terms and technical features shown in fig. 5 and related embodiments, and for the explanation and description of the technical terms and technical features related to the technical terms and technical features shown in fig. 6 and related embodiments, reference may be made to the above explanation of the explanation of fig. 5 and related embodiments, and no further description is provided here.
Fig. 7 shows a block diagram of a data processing apparatus according to an embodiment of the present disclosure, which may be implemented as part or all of an electronic device by software, hardware, or a combination of both. As shown in fig. 7, the data processing apparatus includes:
the migration source 701 is configured to, in response to receiving a data migration command, acquire target migration object data of the migration source and address information of the migration source, and send the target migration object data and the address information of the migration source to a migration destination;
the migration destination 702 is configured to acquire target migration object data and address information of a migration source, perform migration identification processing on the target migration object data, and set source address information of the target migration object data as address information of the migration source.
As mentioned above, with the development of scientific technology and data technology, the application of cloud service technology is becoming more and more widespread. Cloud service providers usually operate massive software and hardware infrastructures, and as online and offline maintenance of equipment, scheduling of resources, and moving of stocks and the like occur more and more frequently, how to reduce data interruption or response time as much as possible during operation and maintenance operations to enable data to be transferred smoothly and reduce the influence of data transfer on users as much as possible, even achieve the imperceptibility of users is a crucial problem for cloud service providers. In the prior art, data migration is usually performed by adopting a hot migration technology, which is effective for most of data to be migrated and basically can achieve user imperceptibility, but generally does not meet the requirement of seamless migration for objects such as processes to be migrated, programs and the like which depend on connection states and source address information.
In view of the above problem, in this embodiment, a data processing apparatus is provided, where target migration target data to be migrated and address information of a migration source are sent to a migration destination together, and after the migration destination obtains the target migration target data and the address information of the migration source, the data processing apparatus sets source address information of the target migration target data as the address information of the migration source, so that when the target migration target sends a message, the data processing apparatus takes the address information of the migration source as the source address information of the target migration target. The technical scheme can not only ensure that most of data to be migrated is insensitive to users under the condition of effective migration, but also meet the requirement of seamless migration of users for objects such as processes to be migrated, programs and the like which depend on connection states and source address information, so that the data service quality can be effectively improved.
In an embodiment of the present disclosure, the data processing apparatus may be implemented as a system including one or more physical machines, one or more physical machines loaded with a virtual machine, or one or more devices running one or more processes or programs and capable of performing migration.
In an embodiment of the present disclosure, after acquiring the target migration object data of the migration source and the address information of the migration source in response to receiving the data migration command, the data migration device is further configured to:
and storing the target migration object data of the migration source into the target migration object file by calling an interface of the data exchange equipment.
In an embodiment of the present disclosure, the sending the target migration object data and the address information of the migration source to the migration destination may be configured to:
sending the target migration object data and the address information of the migration source to a migration destination; or,
and writing the address information of the migration source into the target migration object file, and sending the target migration object file to a migration destination.
In an embodiment of the present disclosure, the target migration object file is a memory file;
the part for sending the target migration object file and the address information of the migration source to the migration destination may be configured to:
and sending the target migration object file and the address information of the migration source to a memory of a migration destination.
In an embodiment of the present disclosure, the migration source is further configured to:
and determining data to be migrated, and sending the data to be migrated to the migration destination.
In an embodiment of the present disclosure, the migration destination may obtain a part of the target migration object data, and may be configured to:
and the migration target responds to the received data migration message and acquires target migration object data from the received target migration object file by calling an interface of the data exchange equipment.
In an embodiment of the present disclosure, the portion for acquiring address information of the migration source may be configured to:
receiving address information of the migration source; or,
and analyzing the received target migration object file to obtain the address information of the migration source.
In an embodiment of the present disclosure, the portion performing migration identification processing on the target migration object data may be configured to:
and setting hot migration identification information for the target migration object data to indicate that the target migration object data is hot migration data.
Technical terms and technical features related to the technical terms and technical features shown in fig. 7 and related embodiments are the same as or similar to those of the technical terms and technical features shown in fig. 5-6 and related embodiments, and for the explanation and description of the technical terms and technical features related to the technical terms and technical features shown in fig. 7 and related embodiments, the above explanation of the explanation of fig. 5-6 and related embodiments can be referred to, and will not be repeated herein.
It should be noted that the above technical solution can be used not only for data live migration in Cloud Service scenarios such as VPC (Virtual Private Cloud) and ECS (Elastic computer Service), but also for data live migration in a database scenario, and other data live migration scenarios capable of implementing migration and target data acquisition based on address information of a migration source.
The embodiment of the present disclosure also discloses an electronic device, which includes a memory and a processor; wherein,
the memory is configured to store one or more computer instructions, wherein the one or more computer instructions are executed by the processor to perform any of the method steps described above.
Fig. 8 is a schematic block diagram of a computer system suitable for implementing a data processing method according to an embodiment of the present disclosure.
As shown in fig. 8, the computer system 800 includes a processing unit 801 which can execute various processes in the above-described embodiments according to a program stored in a Read Only Memory (ROM)802 or a program loaded from a storage section 808 into a Random Access Memory (RAM) 803. In the RAM803, various programs and data necessary for the operation of the system 800 are also stored. The processing unit 801, the ROM802, and the RAM803 are connected to each other by a bus 804. An input/output (I/O) interface 805 is also connected to bus 804.
The following components are connected to the I/O interface 805: an input portion 806 including a keyboard, a mouse, and the like; an output section 807 including a signal such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, and a speaker; a storage portion 808 including a hard disk and the like; and a communication section 809 including a network interface card such as a LAN card, a modem, or the like. The communication section 809 performs communication processing via a network such as the internet. A drive 810 is also connected to the I/O interface 805 as necessary. A removable medium 811 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 810 as necessary, so that a computer program read out therefrom is mounted on the storage section 808 as necessary. The processing unit 801 may be implemented as a CPU, a GPU, a TPU, an FPGA, an NPU, or other processing units.
In particular, the above described methods may be implemented as computer software programs, according to embodiments of the present disclosure. For example, embodiments of the present disclosure include a computer program product comprising a computer program tangibly embodied on a medium readable thereby, the computer program comprising program code for performing the data processing method. In such an embodiment, the computer program may be downloaded and installed from a network via the communication section 809 and/or installed from the removable medium 811.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowcharts or block diagrams may represent a module, a program segment, or a portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units or modules described in the embodiments of the present disclosure may be implemented by software or hardware. The units or modules described may also be provided in a processor, and the names of the units or modules do not in some cases constitute a limitation of the units or modules themselves.
As another aspect, the disclosed embodiment also provides a computer-readable storage medium, which may be the computer-readable storage medium included in the apparatus in the foregoing embodiment; or it may be a separate computer readable storage medium not incorporated into the device. The computer readable storage medium stores one or more programs for use by one or more processors in performing the methods described in the embodiments of the present disclosure.
The foregoing description is only exemplary of the preferred embodiments of the disclosure and is illustrative of the principles of the technology employed. It will be appreciated by those skilled in the art that the scope of the invention in the embodiments of the present disclosure is not limited to the specific combination of the above-mentioned features, but also encompasses other embodiments in which any combination of the above-mentioned features or their equivalents is made without departing from the inventive concept. For example, the above features and (but not limited to) the features with similar functions disclosed in the embodiments of the present disclosure are mutually replaced to form the technical solution.

Claims (36)

1. A method of data processing, comprising:
in response to receiving the data migration command, acquiring target migration object data of a migration source;
acquiring address information of the migration source;
and sending the target migration object data and the address information of the migration source to a migration destination so that the target migration object takes the address information of the migration source as the source address information of the target migration object when sending a message at the migration destination.
2. The method of claim 1, after the obtaining target migration object data of the migration source in response to receiving the data migration command, further comprising:
and storing the target migration object data into a target migration object file by calling an interface of data exchange equipment.
3. The method of claim 2, wherein sending the target migration object data and the address information of the migration source to a migration destination is implemented as:
sending the target migration object file and the address information of the migration source to a migration destination; or,
and writing the address information of the migration source into the target migration object file, and sending the target migration object file to a migration destination.
4. The method according to claim 2 or 3, wherein the target migration object file is a memory file;
the sending of the target migration object data and the address information of the migration source to the migration destination is implemented as:
and sending the target migration object file and the address information of the migration source to a memory of a migration destination.
5. The method of any of claims 1-4, further comprising:
and determining data to be migrated, and sending the data to be migrated to the migration destination.
6. A method of data processing, comprising:
in response to receiving the data migration message, acquiring target migration object data and acquiring address information of a migration source;
carrying out migration identification processing on the target migration object data;
and setting the source address information of the target migration object data as the address information of the migration source, and taking the address information of the migration source as the source address information of the target migration object when the target migration object sends a message.
7. The method of claim 6, the obtaining target migration object data in response to receiving a data migration message implemented to:
and acquiring target migration object data from the received target migration object file by calling an interface of the data exchange equipment in response to the received data migration message.
8. The method according to claim 6 or 7, wherein the obtaining of the address information of the migration source is implemented as:
receiving address information of the migration source; or,
and analyzing the received target migration object file to obtain the address information of the migration source.
9. The method according to any one of claims 6 to 8, wherein the performing migration identification processing on the target migration object data is implemented as:
and setting hot migration identification information for the target migration object data to indicate that the target migration object data is hot migration data.
10. A method of data processing, comprising:
the migration source responds to the received data migration command, obtains target migration object data of the migration source and address information of the migration source, and sends the target migration object data and the address information of the migration source to a migration destination;
the migration destination acquires target migration object data and address information of a migration source, performs migration identification processing on the target migration object data, and sets source address information of the target migration object data as the address information of the migration source.
11. The method according to claim 10, after acquiring the target migration object data of the migration source and the address information of the migration source in response to receiving the data migration command, further comprising:
and storing the target migration object data of the migration source into the target migration object file by calling an interface of the data exchange equipment.
12. The method of claim 11, the sending the target migration object data and the address information of the migration source to a migration destination implemented as:
sending the target migration object data and the address information of the migration source to a migration destination; or,
and writing the address information of the migration source into the target migration object file, and sending the target migration object file to a migration destination.
13. The method according to claim 11 or 12, wherein the target migration object file is a memory file;
the sending of the target migration object file and the address information of the migration source to the migration destination is implemented as:
and sending the target migration object file and the address information of the migration source to a memory of a migration destination.
14. The method according to any of claims 10-13, further comprising:
and the migration source determines data to be migrated and sends the data to be migrated to the migration destination.
15. The method according to claim 11, 12 or 13, the migration destination obtaining target migration object data being implemented as:
and the migration target responds to the received data migration message and acquires target migration object data from the received target migration object file by calling an interface of the data exchange equipment.
16. The method of claim 11, 12, 13 or 15, the obtaining of the address information of the migration source being implemented as:
receiving address information of the migration source; or,
and analyzing the received target migration object file to obtain the address information of the migration source.
17. The method according to any one of claims 10 to 16, wherein the performing migration identification processing on the target migration object data is implemented as:
and setting hot migration identification information for the target migration object data to indicate that the target migration object data is hot migration data.
18. A data processing apparatus comprising:
the storage module is configured to respond to the received data migration command and acquire target migration object data of the migration source;
a first obtaining module configured to obtain address information of the migration source;
the sending module is configured to send the target migration object data and the address information of the migration source to a migration destination, so that the target migration object takes the address information of the migration source as the source address information of the target migration object when sending a message at the migration destination.
19. The apparatus of claim 18, the storage module further comprising, after:
and the storage module is configured to store the target migration object data into a target migration object file by calling an interface of the data exchange device.
20. The apparatus of claim 19, the transmitting module configured to:
sending the target migration object file and the address information of the migration source to a migration destination; or,
and writing the address information of the migration source into the target migration object file, and sending the target migration object file to a migration destination.
21. The apparatus according to claim 19 or 20, wherein the target migration object file is a memory file;
the sending module is configured to:
and sending the target migration object file and the address information of the migration source to a memory of a migration destination.
22. The apparatus of any of claims 18-21, further comprising:
the determining module is configured to determine data to be migrated and send the data to be migrated to the migration destination.
23. A data processing apparatus comprising:
the second acquisition module is configured to respond to the received data migration message, acquire target migration object data and acquire the address information of the migration source;
the identification module is configured to perform migration identification processing on the target migration object data;
a setting module configured to set the source address information of the target migration object data as the address information of the migration source, so as to use the address information of the migration source as the source address information of the target migration object when the target migration object sends a message.
24. The apparatus of claim 23, wherein the second obtaining module, in response to receiving the data migration message, is configured to obtain the portion of the target migration object data, and to:
and acquiring target migration object data from the received target migration object file by calling an interface of the data exchange equipment in response to the received data migration message.
25. The apparatus according to claim 23 or 24, wherein the part of the second obtaining module that obtains the address information of the migration source is configured to:
receiving address information of the migration source; or,
and analyzing the received target migration object file to obtain the address information of the migration source.
26. The apparatus of any of claims 23-25, the identification module configured to:
and setting hot migration identification information for the target migration object data to indicate that the target migration object data is hot migration data.
27. A data processing apparatus comprising:
the migration source is configured to respond to a received data migration command, acquire target migration object data of the migration source and address information of the migration source, and send the target migration object data and the address information of the migration source to a migration destination;
and the migration destination is configured to acquire target migration object data and address information of a migration source, perform migration identification processing on the target migration object data, and set source address information of the target migration object data as address information of the migration source.
28. The apparatus of claim 27, after, in response to receiving the data migration command, acquiring target migration object data of the migration source and address information of the migration source, further configured to:
and storing the target migration object data of the migration source into the target migration object file by calling an interface of the data exchange equipment.
29. The apparatus of claim 28, the portion that sends the target migration object data and the address information of the migration source to a migration destination configured to:
sending the target migration object data and the address information of the migration source to a migration destination; or,
and writing the address information of the migration source into the target migration object file, and sending the target migration object file to a migration destination.
30. The apparatus according to claim 28 or 29, wherein the target migration object file is a memory file;
the part for sending the target migration object file and the address information of the migration source to the migration destination is configured to:
and sending the target migration object file and the address information of the migration source to a memory of a migration destination.
31. The apparatus of any of claims 27-30, the migration source further configured to:
and determining data to be migrated, and sending the data to be migrated to the migration destination.
32. The apparatus according to claim 28, 29 or 30, the migration destination acquiring part of the target migration object data configured to:
and the migration target responds to the received data migration message and acquires target migration object data from the received target migration object file by calling an interface of the data exchange equipment.
33. The apparatus of claim 28, 29, 30 or 32, the portion to obtain address information of a migration source configured to:
receiving address information of the migration source; or,
and analyzing the received target migration object file to obtain the address information of the migration source.
34. The apparatus according to any one of claims 27 to 33, wherein the portion that performs migration identification processing on the target migration object data is configured to:
and setting hot migration identification information for the target migration object data to indicate that the target migration object data is hot migration data.
35. An electronic device comprising a memory and a processor; wherein,
the memory is configured to store one or more computer instructions, wherein the one or more computer instructions are executed by the processor to implement the method steps of any of claims 1-17.
36. A computer-readable storage medium having stored thereon computer instructions, characterized in that the computer instructions, when executed by a processor, carry out the method steps of any of claims 1-17.
CN202010623859.3A 2020-06-30 2020-06-30 Data processing method and device, electronic equipment and computer readable storage medium Pending CN113868218A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010623859.3A CN113868218A (en) 2020-06-30 2020-06-30 Data processing method and device, electronic equipment and computer readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010623859.3A CN113868218A (en) 2020-06-30 2020-06-30 Data processing method and device, electronic equipment and computer readable storage medium

Publications (1)

Publication Number Publication Date
CN113868218A true CN113868218A (en) 2021-12-31

Family

ID=78981057

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010623859.3A Pending CN113868218A (en) 2020-06-30 2020-06-30 Data processing method and device, electronic equipment and computer readable storage medium

Country Status (1)

Country Link
CN (1) CN113868218A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114721592A (en) * 2022-03-14 2022-07-08 北京云宽志业网络技术有限公司 Micro-service storage platform suitable for cold data and use method thereof

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114721592A (en) * 2022-03-14 2022-07-08 北京云宽志业网络技术有限公司 Micro-service storage platform suitable for cold data and use method thereof

Similar Documents

Publication Publication Date Title
US8458284B2 (en) Systems and methods for efficient live application migration within bandwidth constrained networks
US11381631B1 (en) Method to determine use of local and remote applications in a distributed multiuser environment for shared file resources
CN109995877B (en) Information pushing method and device
CN102165739B (en) Reliable reception of messages written via RDMA using hashing
US10657095B2 (en) Virtualizing connection management for virtual remote direct memory access (RDMA) devices
CN110502310B (en) Time synchronization method and device of virtual machine
CN109218356B (en) Method and apparatus for managing stateful applications on a server
CN111126604A (en) Model training method, device, server and storage medium
CN105373563B (en) Database switching method and device
US20180203726A1 (en) Virtual machine migration method and apparatus
CN110740155A (en) Request processing method and device in distributed system
RU2696299C2 (en) Control when initiating elementary tasks on server platform
CN113536168B (en) Component processing method and device
JP2024113165A (en) Data structure, memory means, and device
CN113868218A (en) Data processing method and device, electronic equipment and computer readable storage medium
CN112631994A (en) Data migration method and system
CN117370046A (en) Inter-process communication method, system, device and storage medium
CN112162855A (en) GPU (graphics processing Unit) page missing processing method, system and medium based on page locking memory
CN108696557B (en) Information processing system, method and device
US11954534B2 (en) Scheduling in a container orchestration system utilizing hardware topology hints
US11500622B2 (en) Information processing apparatus, information processing system, and non-transitory computer readable medium for coordinating a switch to an updated program in a cluster to suppress confusion on users
CN113222751A (en) Data migration method and device
US20190141123A1 (en) Non-transitory computer-readable storage medium, process distribution apparatus and process distribution method
CN108733822A (en) A kind of file memory method, device, electronic equipment and storage medium
US11941421B1 (en) Evaluating and scaling a collection of isolated execution environments at a particular geographic location

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 40064974

Country of ref document: HK