CN112445571A - Virtual machine migration and management method, server and computer readable storage medium - Google Patents
Virtual machine migration and management method, server and computer readable storage medium Download PDFInfo
- Publication number
- CN112445571A CN112445571A CN201910839256.4A CN201910839256A CN112445571A CN 112445571 A CN112445571 A CN 112445571A CN 201910839256 A CN201910839256 A CN 201910839256A CN 112445571 A CN112445571 A CN 112445571A
- Authority
- CN
- China
- Prior art keywords
- virtual machine
- snapshot
- source
- volume
- destination
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
- G06F2009/4557—Distribution of virtual machine instances; Migration and load balancing
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The embodiment of the invention discloses a method for migrating and managing a virtual machine, a server and a computer readable storage medium, wherein the method for migrating the virtual machine comprises the following steps: creating a snapshot of a volume of a source virtual machine; creating a new volume according to the snapshot; and transmitting the new volume to a destination host, wherein the new volume is used for generating a destination virtual machine which is consistent with the configuration of the source virtual machine by the destination host. By adopting the embodiment of the invention, the whole virtual machine migration process can be completed within a few seconds, so that the time consumption of the virtual machine migration process is reduced, and the virtual machine migration efficiency is improved.
Description
Technical Field
The invention relates to a virtual machine migration technology in the technical field of cloud computing, in particular to a virtual machine migration and management method, a server and a computer readable storage medium.
Background
Cloud computing is a network computing mode, and its Service modes include three major categories, namely SaaS (Software-as-a-Service), PaaS (Platform-as-a-Service), and IaaS (Infrastructure-as-a-Service). The services provided by IaaS to the user are the utilization of all computing infrastructure, including computing resources such as processors, memory, storage, networks, etc., on which the user can deploy and run arbitrary software, including operating systems and applications, which the IaaS leases to the user in the form of virtual machines. With the increase of the number of rented virtual machines, the virtual machines need to be migrated, so that the virtual machines rented by different users are migrated to the host where one of the virtual machines is located, and the unified management of computing resources is realized.
In the prior art, a mode of copying a memory of a source virtual machine to a target virtual machine is mainly adopted, so that migration of the virtual machine is realized. Because the service on the source virtual machine is continuously running in the copying process, the memory of the source virtual machine is continuously changed, so that the changed memory needs to be repeatedly copied in the migration process of the virtual machine until the memories on the two sides of the source virtual machine and the target virtual machine are consistent, and the problem of overlong time consumed by the migration of the virtual machine exists in the method, and the migration efficiency of the virtual machine is influenced.
Disclosure of Invention
In order to solve the above technical problems, embodiments of the present invention provide a method, a server, and a computer-readable storage medium for migrating and managing a virtual machine, which can reduce time consumption in a virtual machine migration process and improve virtual machine migration efficiency.
The technical scheme of the invention is realized as follows:
a first aspect of an embodiment of the present invention provides a method for migrating a virtual machine, including:
creating a snapshot of a volume of a source virtual machine;
creating a new volume according to the snapshot;
and transmitting the new volume to a destination host, wherein the new volume is used for generating a destination virtual machine which is consistent with the configuration of the source virtual machine by the destination host.
As a first possible implementation manner of the first aspect, the creating a snapshot of a volume of a source virtual machine includes:
obtaining a first text for describing a volume of the source virtual machine;
replacing the Chinese characters in the first text with corresponding English characters according to a set mapping relation between the Chinese characters and the English characters to obtain a second text;
creating a snapshot for the volume of the source virtual machine, and saving the second text as description information of the snapshot.
As a second possible implementation manner of the first aspect, the creating a snapshot of a volume of a source virtual machine includes:
determining a service identifier corresponding to the source virtual machine, wherein the service identifier is used for representing a service running on the source virtual machine;
creating a snapshot for the volume of the source virtual machine, and saving the service identifier as the description information of the snapshot.
A second aspect of the embodiments of the present invention provides a method for managing a virtual machine, including:
receiving a virtual machine identifier of a destination virtual machine sent by a destination host, wherein the destination virtual machine is a virtual machine which is generated by the destination host according to a new volume transmitted by a source host and is consistent with the configuration of the source virtual machine, and the new volume is generated according to a snapshot after the source host creates the snapshot on a volume of the source virtual machine;
associating, by the virtual machine identifier, operating data of the destination virtual machine, the operating data including metadata of the destination virtual machine and at least one of authority data and order data of the destination virtual machine;
and synchronously updating each item of running data associated with the virtual machine identifier.
As a first possible implementation manner of the second aspect, before the identifying, by the virtual machine, the running data associated with the destination virtual machine, the method further includes:
and acquiring the state information of the target virtual machine by adopting a polling mechanism until the service on the target virtual machine is started.
A third aspect of an embodiment of the present invention provides a server, including:
the snapshot unit is used for creating a snapshot for the volume of the source virtual machine;
a creating unit configured to create a new volume according to the snapshot;
and the transfer unit is used for transferring the new volume to a destination host, and the new volume is used for generating a destination virtual machine consistent with the configuration of the source virtual machine by the destination host.
A fourth aspect of the present invention provides an apparatus for virtual machine management, including:
a receiving unit, configured to receive a virtual machine identifier of a destination virtual machine sent by a destination host, where the destination virtual machine is a virtual machine that is generated by the destination host according to a new volume transmitted by a source host and is consistent with a configuration of the source virtual machine, and the new volume is generated by the source host after creating a snapshot for a volume of the source virtual machine and then generating according to the snapshot;
the association unit is used for associating the running data of the target virtual machine through the virtual machine identifier, wherein the running data comprises metadata of the target virtual machine and at least one of authority data and order data of the target virtual machine;
and the synchronization unit is used for synchronously updating each item of running data associated with the virtual machine identifier.
A fifth aspect of an embodiment of the present invention provides a server, including:
a receiver, a transmitter, a processor and a storage medium storing processor-executable instructions, data received by the receiver and data transmitted by the transmitter, the receiver, the transmitter and the storage medium rely on the processor to perform operations via a communication bus, and when the instructions are executed by the processor, the method of virtual machine migration according to the first aspect of the embodiment of the present invention is performed.
A sixth aspect of the present invention provides an apparatus for virtual machine management, including:
a receiver, a transmitter, a processor and a storage medium storing processor-executable instructions, received data of the receiver and transmitted data of the transmitter, the receiver, the transmitter and the storage medium relying on the processor to perform operations via a communication bus, the instructions, when executed by the processor, performing the method of virtual machine management according to the second aspect of the embodiment of the present invention described above.
A seventh aspect of embodiments of the present invention provides a computer-readable storage medium, which stores machine instructions, and when the machine instructions are executed by one or more processors, the processors execute the method for virtual machine migration described in the first aspect or any one of the possible implementations of the first aspect of embodiments of the present invention, or the method for virtual machine management described in the second aspect or the first possible implementation of the second aspect.
According to the virtual machine migration method provided by the embodiment of the invention, the snapshot is created on the volume of the source virtual machine, the new volume is created by taking the snapshot as the data source, and the new volume is transmitted to the destination host, so that the destination virtual machine which is completely consistent with the configuration of the source virtual machine is generated on the destination host.
Drawings
Fig. 1 is a schematic flow chart of an implementation process of a method for virtual machine migration according to an embodiment of the present invention;
fig. 2 is a schematic flow chart of implementation of creating a snapshot in a method for virtual machine migration according to an embodiment of the present invention;
fig. 3 is a schematic flow chart illustrating an implementation of creating a snapshot in a method for virtual machine migration according to another embodiment of the present invention;
fig. 4 is a schematic flow chart of an implementation of a method for virtual machine management according to an embodiment of the present invention;
fig. 5 is a flowchart illustrating an implementation of a method for virtual machine management according to another embodiment of the present invention;
fig. 6 is a diagram of an implementation example of a method for virtual machine migration and management according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of a server according to an embodiment of the present invention;
fig. 8 is a schematic hardware structure diagram of a server according to an embodiment of the present invention;
fig. 9 is a schematic structural diagram of a server according to another embodiment of the present invention;
fig. 10 is a schematic diagram of a hardware structure of a server according to another embodiment of the present invention.
Detailed Description
The technical solution in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention.
In order to better describe the method for migrating and managing the virtual machine provided by the embodiment of the present invention, firstly, the architecture of the cloud computing platform is explained:
in the embodiment of the present invention, the cloud computing platform may be various cloud computing platforms that adopt an IaaS service mode, for example, an OpenStack cloud computing platform, which provides solutions such as cloud computing and cloud storage to a user in a public cloud or private cloud manner. The computing resources provided by IaaS to users are integrated at the bottom layer of the cloud computing platform, and physically, the computing resources exist in the form of cluster hosts, and a group of the cluster hosts may be composed of hundreds of hosts. The hosts forming the cluster host are usually servers with better operation performance, and have the characteristics of high memory, fast CPU, large disk space and the like, and the cluster architecture mode can improve the operation performance of the cluster host by using a distributed technology. Through virtualization technology, entity operation units of the hosts are cut into different virtual machines, a user can rent one to a plurality of virtual machines, deploy services on the rented virtual machines, run application programs and generate data.
In the embodiment of the invention, virtual machines rented by different users are migrated, and the virtual machines are migrated to the host where the virtual machine rented by one user is located, so that the unified management of the virtual machines rented by different users is realized on the basis of the migration. For example, one or more virtual machines running in host a are migrated to host B, and for convenience of explanation, host a is referred to as a source host, the one or more virtual machines that need to be migrated are referred to as a source virtual machine, and host B is referred to as a destination host, and the one or more virtual machines are referred to as destination virtual machines after being migrated to host B. In the embodiment of the invention, after all or part of the virtual machines running on a plurality of source hosts are migrated to one target host, the virtual machines can be managed on the level of bottom computing resources no longer, but unified management on the part of the virtual machines can be realized on the upper layer of a cloud computing platform, various running data of the part of the virtual machines are synchronously updated through a database technology, and the running state and the charging condition of the virtual machines are mastered in real time.
Based on the above-described architecture of the cloud computing platform, fig. 1 shows a schematic implementation flow diagram of a method for virtual machine migration according to an embodiment of the present invention, and in the following embodiment, an execution subject of the method for virtual machine migration is any source host located in a cluster host. Referring to fig. 1, the method of virtual machine migration includes S101 to S103 shown in fig. 1.
S101: a Snapshot (Snapshot) is created of the volume of the source virtual machine.
Virtual Machine (Virtual Machine) refers to a complete computer system with complete hardware system functions, which is simulated by software and runs in a completely isolated environment. The volume of the source virtual machine comprises a system disk and a hanging disk of the source virtual machine, wherein the system disk is a disk partition of an operating system provided with the source virtual machine, and the hanging disk is other disk partitions except the system disk in the source virtual machine. The snapshot function, which is a function of data backup provided by an operating system, can copy data in a disk partition of a virtual machine at a specified time point, and thus create a snapshot for a volume of a source virtual machine, that is, create an instant copy for the volume of the source virtual machine at the time point when the snapshot is created.
S102: a new volume is created from the snapshot.
In the embodiment of the present invention, a new volume is created under a source virtual machine by taking a snapshot as a data source, and subsequent virtual machine migration processes are all performed on the basis of the new volume, so that, in the process of migrating the source virtual machine, the source virtual machine does not need to be stopped, and a service originally deployed on the source virtual machine can be further performed. It should be noted that, in the virtual machine migration process, the service deployed on the source virtual machine is still in progress, and the snapshot is created at the beginning of the virtual machine migration, so that new data generated by the service running on the source virtual machine in the virtual machine migration process is not migrated to the destination virtual machine, which may cause data loss. However, at the beginning of the migration of the virtual machine, the service on the source virtual machine is deployed and completed, so most of the data lost during this period is log data generated in the service running process, under the condition that the service is running normally, the log data does not need to be checked, the time consumption of the whole virtual machine migration process is short, even if the log data is lost, the log data can be ignored, and the normal running of the service is not affected.
S103: and transmitting the new volume to the destination host, wherein the new volume is used for generating the destination virtual machine consistent with the configuration of the source virtual machine by the destination host.
In the embodiment of the invention, the source host transfers the new volume to the destination host by calling the block storage component of the cloud computing platform and utilizing the volume transfer function in the block storage component. Taking OpenStack as an open-source cloud computing platform as an example, a block storage component of the cloud computing platform is a binder, and the volume transfer function is implemented as follows: the transfer-create command in the binder is used to transfer ownership of a volume from one host to another, so the source host can transfer the new volume to the destination host through the transfer-create command. When the transfer-create command is executed, the destination host receives the volume transfer request, and the destination host executes an allowance operation on the volume transfer request by using the transfer-accept command, so that the new volume can be received. In addition, in the process of transferring the new volume, when a transfer-create command is executed, a transfer identifier and an authentication key related to the new volume are generated, the generated transfer identifier and the generated authentication key are sent to the destination host, the transfer identifier and the authentication key are stored in a database inside the cloud computing platform in a set mode and serve as a target host to receive the certificate of the new volume, and the cloud computing platform provides a service for receiving verification for the host at any time. When the destination host uses the transfer-accept command, the transfer identifier and the authentication key corresponding to the new volume need to be input, the cloud computing platform completes verification according to the transfer identifier and the authentication key which are stored in the database and are related to the new volume, and after the verification is completed, the new volume is transmitted to the destination host.
In the embodiment of the invention, after receiving a new volume, a target host initiates a starting request by taking the new volume as an example, the starting request is sent to a computing component in a cloud computing platform, the computing component requests a block storage component to start the creation of an image volume after receiving the starting request, the block storage component requests an image service component to download an image, after the image is downloaded, the creation of the image volume is completed, and finally the computing component executes a virtual machine creating process based on the image volume, so that a target virtual machine completely consistent with the configuration of a source virtual machine can be locally generated in the target host. Illustratively, taking OpenStack as an example, the above computing component is Nova component in OpenStack, the block storage component is circer component in OpenStack, and the mirror service component is glare component in OpenStack.
The virtual machine migration method provided by the embodiment of the invention creates the snapshot for the volume of the source virtual machine, creates the new volume by taking the snapshot as the data source, and transmits the new volume to the destination host, so that the destination virtual machine completely consistent with the configuration of the source virtual machine is generated on the destination host, the migration process of the whole virtual machine can be completed in a short time, such as only a few seconds, and the normal operation of the service deployed on the virtual machine is not influenced. In contrast, in the virtual machine migration method for memory replication in the prior art, a destination virtual machine configured as the same as a source virtual machine needs to be started on a host machine in advance, and then a memory of the source virtual machine is copied to the destination virtual machine. The virtual machine migration method provided by the embodiment of the invention does not create the target virtual machine at the beginning of virtual machine migration, but creates the target virtual machine by using the volume transmitted by the source host, and simultaneously directly migrates the deployed services before virtual machine migration to the target virtual machine together, so that the services do not need to be redeployed, and the efficiency of data migration is effectively improved.
In addition, in the prior art, the virtual machine is created on the cluster host at the bottom layer of the cloud computing platform, and the service of the cloud computing platform for docking the virtual machine is a forward synchronization service from the upper layer to the bottom layer of the cloud computing platform, that is, the service is that a password is generated on the upper layer of the cloud computing platform through an encryption algorithm and is synchronized to the bottom layer, and the user logs in the cloud computing platform at the bottom layer, so that the user and the user are isolated from each other in practice, and any user cannot log in the cloud computing platform from the bottom layer reversely by using the password, so that the management of the virtual machine rented by other users is realized. Based on the virtual machine migration method provided by the embodiment of the invention, all the virtual machines rented by different users can be migrated to one host, and the users can manage the migrated virtual machines on the host, thereby realizing the cross-user unified management of the virtual machines.
In the above embodiment, a snapshot needs to be created on a volume of a source virtual machine first, and in the process of creating the snapshot, description information is usually added to the snapshot in order to better describe the data content in the snapshot. In the prior art, if a chinese character exists in the description information, the snapshot is always in the creation state and cannot be created completely, so that the progress of virtual machine migration is affected. As shown in fig. 2, in the embodiment corresponding to fig. 1, the step of creating a snapshot on the volume of the source virtual machine is detailed as S201 to S203:
s201: text describing a volume of a source virtual machine is obtained.
In the embodiment of the present invention, the text used for describing the volume of the source virtual machine may be the attribute information of the volume, such as the name, data size, and file system type of the volume, and may be obtained by reading the attribute information of the volume; in this case, the text is usually input in the textbox control by the user before creating the snapshot, and thus the text can be obtained by extracting the text in the textbox.
S202: and replacing the Chinese characters in the text with corresponding English characters according to the set mapping relation between the Chinese characters and the English characters.
In the embodiment of the invention, the mapping relation which corresponds to one between the Chinese character and the English character is preset, the mapping relation can be stored in a database in a form of a data table in advance, after the text which is used for describing the volume of the source virtual machine is obtained, the database is called to access the data table, the Chinese character is used as a query condition to be queried in the data table, the query result is the English character which corresponds to the Chinese character, and the Chinese character is replaced in the text according to the query result.
In the aspect of character replacement, judgment logic is added in a code segment for coding the existing characters, and the judgment logic is used for judging the characters in the text one by one so as to detect whether the Chinese characters exist in the text. If the Chinese character exists in the text detected by the judging logic, the Chinese character is replaced by the corresponding English character. S203: and creating a snapshot for the volume of the source virtual machine, and taking the text as description information of the snapshot.
In the embodiment shown in fig. 2, by character replacement, the situation that the snapshot creation process is too long due to the problem of incompatibility of chinese characters is avoided, the snapshot creation speed is further increased, and thus the virtual machine migration efficiency is increased.
In addition, since the services deployed on different virtual machines are different and virtual machine migration is often performed in batches, as an embodiment of the present invention, a service identifier is added to the description information of the snapshot, where the service identifier is used to represent a service running on a corresponding virtual machine. As shown in fig. 3, in the embodiment corresponding to fig. 1, the step of creating a snapshot on the volume of the source virtual machine is detailed as S301 to S302:
s301: and determining a service identifier corresponding to the source virtual machine, wherein the service identifier is used for representing a service running on the source virtual machine.
S302: and creating a snapshot for the volume of the source virtual machine, and saving the service identifier as the description information of the snapshot.
In the embodiment of the present invention, the service identifier may be a service code composed of numbers or characters, for example, the service code "a 001" represents the telephone fee inquiry service, and the service code "b 030" represents the package change service. After the service identifier is saved as the description information of the snapshot, the services to which different new volumes belong can be distinguished conveniently, so that the virtual machines corresponding to different services can be distinguished conveniently in the virtual machine migration process, the virtual machines can be guaranteed to be correctly attributed to the corresponding services after migration is completed, and the virtual machine migration efficiency is further improved.
The above embodiments are used to illustrate how to migrate virtual machines rented by different users in a cloud computing platform to one of the hosts for running, and after the migration of the virtual machines is completed, the virtual machines can be uniformly managed from the upper layer of the cloud computing platform. Fig. 4 is a schematic implementation flow diagram of a method for virtual machine management according to an embodiment of the present invention, in the following embodiment, a main body of the method for virtual machine management is a server, it should be noted that the server is not the above-mentioned server located at the bottom layer of the cloud computing platform and existing as a computing resource, but a server for uniformly managing virtual machines rented by different users in the cloud computing platform is deployed at the upper layer of the cloud computing platform, and for convenience of description, the server is hereinafter collectively referred to as an operation server. Referring to fig. 4, the method of virtual machine management includes S401 to S403 illustrated in fig. 4.
S401: and receiving a virtual machine identifier of a destination virtual machine sent by a destination host, wherein the destination virtual machine is a virtual machine which is generated by the destination host according to a new volume transmitted by a source host and is consistent with the configuration of the source virtual machine, and the new volume is generated according to a snapshot after the source host creates the snapshot on the volume of the source virtual machine.
In the embodiment shown in fig. 1, a snapshot is created in the source host for the volume of the source virtual machine, a new volume is created under the source virtual machine with the snapshot as a data source, and the new volume is transferred to the destination host by the source host by calling the block storage component of the cloud computing platform and using the volume migration function in the block storage component. After receiving a new volume, a target host initiates a starting request by taking the new volume as an example, the starting request is sent to a computing component in a cloud computing platform, the computing component requests a block storage component to start the creation of an image volume after receiving the starting request, then the block storage component requests an image service component to download an image, after the image is downloaded, the creation of the image volume is completed, and finally the computing component executes a virtual machine creating process based on the image volume, so that a target virtual machine completely consistent with the configuration of a source virtual machine can be locally generated on the target host.
When the destination host creates the destination virtual machine, a virtual machine identifier for marking the destination virtual machine is generated, and the virtual machine identifier has uniqueness and can uniquely mark the destination virtual machine in all virtual machine resources. In the embodiment of the present invention, the virtual machine identifier serves as metadata of the destination virtual machine, and plays a role in associating the operation data of the destination virtual machine. And after the target host generates the virtual machine identifier, the virtual machine identifier is sent to the operation server.
S402: and identifying running data associated with the target virtual machine through the virtual machine, wherein the running data comprises metadata of the target virtual machine and at least one of authority data and order data of the target virtual machine. S403: and synchronously updating each item of running data associated with the virtual machine identifier.
In the embodiment of the invention, the operation server is connected with a database in a butt joint mode, and the database can be a database located at the local part of the operation server or a remote database which needs to be accessed through a calling interface. In the embodiment of the invention, the metadata, the permission data and the order data corresponding to the target virtual machine correspond to the corresponding data linked lists in the database respectively, and the metadata, the permission data and the order data of the source virtual machine can be synchronously updated based on the database script by associating the virtual machine identifier of the target virtual machine with each item of running data of the target virtual machine.
In each item of running data of the target virtual machine, the metadata is used for describing the attribute of the target virtual machine, and may include information such as a subnet, a network card or mounted storage corresponding to the target virtual machine, and the updating of the metadata is mainly performed when the target virtual machine is just created, so that the attribute of the target virtual machine can be recorded and can be conveniently viewed as management information; the permission data is used for indicating the opening condition of the operation permission of the target virtual machine to the cloud computing platform account, wherein for a main account with management permission in the cloud computing platform, the operation permission of the virtual machine is opened to the main account as long as the virtual machine is online, and for a sub-account with only the use permission of the virtual machine under the main account, generally speaking, the sub-account can acquire the operation permission of the virtual machine after the rented virtual machine is migrated; the order data is used for indicating the renting condition of the target virtual machine, the order data is effective after the target virtual machine is created and deployed with the service, and the order data can comprise parameters such as the specification, the type, the renting price or the payment mode of the virtual machine.
In the embodiment of the invention, the virtual machine identification is used as an index to synchronously update various running data of the target virtual machine, so that the real-time performance and reliability of the data in the process of uniformly managing the virtual machines rented by different users are ensured, and meanwhile, a manager can call and check various running data of the target virtual machine by logging in a management page of a cloud computing platform, so that the management and charging of the target virtual machine are realized on the basis.
Based on the embodiment shown in fig. 4, after the new volume is transferred to the destination host, since a short time elapses from the time the destination host starts receiving the new volume to the time the destination virtual machine starts running the service normally, the destination host creates the destination virtual machine, and the service deployment and service startup are completed on the destination virtual machine, as shown in fig. 5, S502 to S504 thereof correspond to S401 to S403 in the embodiment of fig. 4, respectively, and before S503, the method further includes S501.
S501: and acquiring the state information of the target virtual machine by adopting a polling mechanism until the service on the target virtual machine is started.
S502: and receiving a virtual machine identifier of a destination virtual machine sent by a destination host, wherein the destination virtual machine is a virtual machine which is generated by the destination host according to a new volume transmitted by a source host and is consistent with the configuration of the source virtual machine, and the new volume is generated according to a snapshot after the source host creates the snapshot on the volume of the source virtual machine.
S503: and identifying running data associated with the target virtual machine through the virtual machine, wherein the running data comprises metadata of the target virtual machine and at least one of authority data and order data of the target virtual machine.
S504: and synchronously updating each item of running data associated with the virtual machine identifier.
In the embodiment of the invention, before the running data of the target virtual machine is associated with the virtual machine identifier, the state information of the target virtual machine is acquired in a polling mode. The polling is an operation of sending out an inquiry at regular time, sequentially inquiring the state information of each target virtual machine, completing a polling inquiry, and restarting a new round of inquiry after acquiring the state information of each target virtual machine. Because the computing resources corresponding to the target virtual machine are successfully opened at the bottom layer of the cloud computing platform, the state information of the target virtual machine is also in an acquirable state, and in order to ensure that the data of the operation layer is consistent with the resource condition in the cloud computing platform in real time, the embodiment of the invention completes the development of related polling logic by using an asynchronous thread technology, continuously and repeatedly calls a bottom layer interface of the cloud computing platform, acquires the state information of the target virtual machine by using the virtual machine identifier and makes corresponding logic judgment until the service is successfully deployed and operated on the target virtual machine and starts to generate order data. In addition, through the design of information synchronization, the management page displayed by the application layer of the cloud computing platform is updated synchronously, the problem that page display data is inconsistent with actual operation data of the virtual machine in the virtual machine migration process can be solved, and the most real-time and accurate virtual machine state information can be displayed for a manager and a user renting the virtual machine. Because the number of virtual machines is relatively large, and the state information quantity is relatively large, compared with a mode that a large amount of data needs to be exported from the bottom layer of a cloud computing platform and then imported into an upper management page in the prior art, the scheme is quicker and more accurate in the aspect of real-time data display.
It should be noted that, in the embodiment corresponding to fig. 5, both S501 and S502 are executed before S503, the virtual machine identifier is generated in the process of creating the destination virtual machine by the destination host and is sent to the operation server after the virtual machine identifier is generated, and the state of the destination virtual machine is continuously obtained by polling in the process of creating the destination virtual machine and in the process of performing service deployment after the destination virtual machine is created, so that there is no absolute sequence in the execution of S501 and S502.
In order to better explain the above-described embodiments, the following describes an implementation flow of a migration and management method of a virtual machine in combination with an actual scene. Fig. 6 shows an implementation example of a method for migrating and managing a virtual machine according to an embodiment of the present invention, in this example, a virtual machine 1, a virtual machine 2, a virtual machine 3, and a virtual machine 4 respectively run on a host 1, a host 2, a host 3, and a host 4, are leased by different users, and it is necessary to migrate the virtual machine 2, the virtual machine 3, and the virtual machine 4 to the host 1 with the host 1 as a destination host, with reference to fig. 6, this implementation example includes the following processes:
1. the host 2, the host 3 and the host 4 serve as source hosts, respectively create snapshots for the volumes of the virtual machines 2, 3 and 4 which are respectively operated, and create new volumes according to the snapshots. The host 2, the host 3, and the host 4 transfer the new volume to the host 1, and authenticate the host 1 during the transfer of the new volume based on the generated transfer identification and the authentication key.
2. After receiving the new volume, the host 1 creates and generates a mirror volume based on the new volume, and executes a virtual machine creation process to respectively generate three virtual machines 5, 6 and 7 which are completely consistent with the configuration of the virtual machine 2, 3 and 4, where the virtual machine 5, 6 and 7 are the target virtual machines mentioned above.
3. The operation server associates the operation data of the virtual machines 1, 5, 6 and 7 respectively according to the virtual machine identifiers of the virtual machines 1, 5, 6 and 7 by calling the database, synchronously updates each operation data, and the manager can check the operation data of the virtual machines 1, 5, 6 and 7 in real time through logging in a management page and uniformly manage the virtual machines 1, 5, 6 and 7 based on the operation data.
According to the virtual machine migration method provided by the embodiment of the invention, the snapshot is created on the volume of the source virtual machine, the new volume is created by taking the snapshot as the data source, and the new volume is transmitted to the target host, so that the target virtual machine completely consistent with the configuration of the source virtual machine is generated on the target host, the data migration process of the whole virtual machine can be completed within a few seconds, and the normal operation of the service deployed on the virtual machine is not influenced. The virtual machine management method provided by the embodiment of the invention synchronously updates the running data of the virtual machines rented by different users through the virtual machine identifiers on the basis of virtual machine migration, thereby meeting the requirements of unified management and charging of the virtual machines rented by different users.
Based on the foregoing embodiment of the method for virtual machine migration, fig. 7 is a schematic diagram of a composition structure of a server according to an embodiment of the present invention, where the server is integrated as a computing resource at a bottom layer of a cloud computing platform, and is used as a source host where a source virtual machine is located in a virtual machine migration process, and is an execution subject of the method for virtual machine migration in the foregoing embodiment. As shown in fig. 7, in the embodiment of the present invention, the server 1 includes: a snapshot unit 11, a creation unit 12 and a transfer unit 13.
And the snapshot unit 11 is configured to create a snapshot for the volume of the source virtual machine.
A creating unit 12 for creating a new volume from the snapshot.
And a transfer unit 13 configured to transfer a new volume to the destination host, the new volume being used by the destination host to generate the destination virtual machine in accordance with the configuration of the source virtual machine.
Further, as an embodiment of the present invention, the snapshot unit 11 is configured to:
acquiring a first text for describing a volume of a source virtual machine;
replacing the Chinese characters in the first text with corresponding English characters according to a set mapping relation between the Chinese characters and the English characters to obtain a second text;
and creating a snapshot for the volume of the source virtual machine, and saving the second text as description information of the snapshot.
Further, as an embodiment of the present invention, the snapshot unit 11 is configured to:
determining a service identifier corresponding to a source virtual machine, wherein the service identifier is used for representing a service running on the source virtual machine;
and creating a snapshot for the volume of the source virtual machine, and saving the service identifier as description information of the snapshot.
Based on the foregoing embodiment of the method for virtual machine migration, fig. 8 is a schematic diagram of a hardware structure of a server according to an embodiment of the present invention, where the server is integrated as a computing resource at a bottom layer of a cloud computing platform, and is used as a source host where a source virtual machine is located in a virtual machine migration process, and is an execution subject of the method for virtual machine migration in the foregoing embodiment. As shown in fig. 8, the server includes:
the receiver 114, the transmitter 113, the processor 112, and the storage medium 115 storing the processor 112 executable instructions, the received data of the receiver 114, and the data transmitted by the transmitter 113, the receiver 114, the transmitter 113, and the storage medium depend on the processor 112 through the communication bus 116 to perform operations, and when the instructions are executed by the processor 112, the method of virtual machine migration described in the above embodiments is performed, including:
creating a snapshot of a volume of a source virtual machine;
creating a new volume from the snapshot;
and transmitting the new volume to the target host, wherein the new volume is used for generating the target virtual machine consistent with the configuration of the source virtual machine by the target host.
Further, creating a snapshot of a volume of the source virtual machine, comprising:
acquiring a first text for describing a volume of a source virtual machine;
replacing the Chinese characters in the first text with corresponding English characters according to a set mapping relation between the Chinese characters and the English characters to obtain a second text;
and creating a snapshot for the volume of the source virtual machine, and saving the second text as description information of the snapshot.
Further, creating a snapshot of a volume of the source virtual machine, comprising:
determining a service identifier corresponding to a source virtual machine, wherein the service identifier is used for representing a service running on the source virtual machine;
and creating a snapshot for the volume of the source virtual machine, and saving the service identifier as description information of the snapshot.
It should be noted that, in actual practice, the various components in the computing device are coupled together by a communication bus 116. It is understood that the communication bus 116 is used to enable connective communication between these components. The communication bus 116 includes a power bus, a control bus, and a status signal bus in addition to a data bus. But for clarity of illustration the various buses are labeled in figure 8 as communication bus 116.
Based on the foregoing embodiment of the method for managing virtual machines, fig. 9 is a schematic structural diagram of a server according to an embodiment of the present invention, where the server is deployed in an upper layer of a cloud computing platform, is used to perform unified management on virtual machines rented by different users, and is an execution subject of the method for managing virtual machines in the foregoing embodiment. As shown in fig. 9, in the embodiment of the present invention, the server 2 includes: a receiving unit 21, an associating unit 22 and a synchronizing unit 23.
A receiving unit 21, configured to receive a virtual machine identifier of a destination virtual machine sent by a destination host, where the destination virtual machine is a virtual machine that is generated by the destination host according to a new volume transmitted by a source host and is consistent with a configuration of the source virtual machine, and the new volume is generated by the source host after creating a snapshot for a volume of the source virtual machine;
the association unit 22 is configured to associate, by the virtual machine identifier, running data of the destination virtual machine, where the running data includes metadata of the destination virtual machine, and at least one of authority data and order data of the destination virtual machine;
and the synchronizing unit 23 is configured to perform synchronous updating on each item of running data associated with the virtual machine identifier.
Further, the server 2 further includes:
and the polling unit is used for acquiring the state information of the target virtual machine by adopting a polling mechanism until the service on the target virtual machine is started.
Based on the foregoing embodiment of the method for managing virtual machines, fig. 9 is a schematic diagram of a hardware structure of a server according to an embodiment of the present invention, where the server is deployed in an upper layer of a cloud computing platform, is used to perform unified management on virtual machines rented by different users, and is an execution subject of the method for managing virtual machines in the foregoing embodiment. As shown in fig. 10, the server includes:
the receiver 214, the sender 213, the processor 212, and the storage medium 215 storing instructions executable by the processor 212, data received by the receiver 214, and data sent by the sender 213, the receiver 214, the sender 213, and the storage medium 215 depend on the processor 212 to perform operations through the communication bus 216, and when the instructions are executed by the processor 212, the method for managing the virtual machine described in the above embodiments is performed, including:
receiving a virtual machine identifier of a target virtual machine sent by a target host, wherein the target virtual machine is a virtual machine which is generated by the target host according to a new volume transmitted by a source host and is consistent with the configuration of the source virtual machine, and the new volume is generated according to a snapshot after the source host creates the snapshot on the volume of the source virtual machine;
associating running data of a target virtual machine through a virtual machine identifier, wherein the running data comprises metadata of the target virtual machine and at least one of authority data and order data of the target virtual machine;
and synchronously updating each item of running data associated with the virtual machine identifier.
Further, before identifying, by the virtual machine, the running data associated with the destination virtual machine, the method further includes:
and acquiring the state information of the target virtual machine by adopting a polling mechanism until the service on the target virtual machine is started.
It should be noted that, in practice, the various components in the server are coupled together by a communication bus 216. It is understood that the communication bus 216 is used to enable connective communication between these components. The communication bus 216 includes a power bus, a control bus, and a status signal bus in addition to a data bus. But for clarity of illustration the various buses are labeled in figure 10 as communication bus 216.
Embodiments of the present invention further provide a computer-readable storage medium, where the computer-readable storage medium stores machine instructions, and when the machine instructions are executed by one or more processors, the processors execute the method for migrating a virtual machine in the foregoing embodiments, where the method includes:
creating a snapshot of a volume of a source virtual machine;
creating a new volume from the snapshot;
and transmitting the new volume to the target host, wherein the new volume is used for generating the target virtual machine consistent with the configuration of the source virtual machine by the target host.
Further, creating a snapshot of a volume of the source virtual machine, comprising:
acquiring a first text for describing a volume of a source virtual machine;
replacing the Chinese characters in the first text with corresponding English characters according to a set mapping relation between the Chinese characters and the English characters to obtain a second text;
and creating a snapshot for the volume of the source virtual machine, and saving the second text as description information of the snapshot.
Further, creating a snapshot of a volume of the source virtual machine, comprising:
determining a service identifier corresponding to a source virtual machine, wherein the service identifier is used for representing a service running on the source virtual machine;
and creating a snapshot for the volume of the source virtual machine, and saving the service identifier as description information of the snapshot.
Embodiments of the present invention also provide another computer-readable storage medium, where the computer-readable storage medium stores machine instructions, and when the machine instructions are executed by one or more processors, the processors execute the method for managing a virtual machine in the foregoing embodiments, where the method includes:
receiving a virtual machine identifier of a target virtual machine sent by a target host, wherein the target virtual machine is a virtual machine which is generated by the target host according to a new volume transmitted by a source host and is consistent with the configuration of the source virtual machine, and the new volume is generated according to a snapshot after the source host creates the snapshot on the volume of the source virtual machine;
associating running data of a target virtual machine through a virtual machine identifier, wherein the running data comprises metadata of the target virtual machine and at least one of authority data and order data of the target virtual machine;
and synchronously updating each item of running data associated with the virtual machine identifier.
Further, before identifying, by the virtual machine, the running data associated with the destination virtual machine, the method further includes:
and acquiring the state information of the target virtual machine by adopting a polling mechanism until the service on the target virtual machine is started.
The computer-readable storage medium may be a magnetic random access Memory (FRAM), a Read Only Memory (ROM), a Programmable Read Only Memory (PROM), an Erasable Programmable Read Only Memory (EPROM), an Electrically Erasable Programmable Read Only Memory (EEPROM), a Flash Memory (Flash Memory), a magnetic surface Memory, an optical Disc, or a Compact Disc Read-Only Memory (CD-ROM), among others.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of a hardware embodiment, a software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The above description is only a preferred embodiment of the present invention, and is not intended to limit the scope of the present invention.
Claims (10)
1. A method of virtual machine migration, comprising:
creating a snapshot of a volume of a source virtual machine;
creating a new volume according to the snapshot;
and transmitting the new volume to a destination host, wherein the new volume is used for generating a destination virtual machine which is consistent with the configuration of the source virtual machine by the destination host.
2. The method of virtual machine migration according to claim 1, wherein the creating a snapshot of a volume of a source virtual machine comprises:
obtaining a first text for describing a volume of the source virtual machine;
replacing the Chinese characters in the first text with corresponding English characters according to a set mapping relation between the Chinese characters and the English characters to obtain a second text;
creating a snapshot for the volume of the source virtual machine, and saving the second text as description information of the snapshot.
3. The method of virtual machine migration according to claim 1, wherein the creating a snapshot of a volume of a source virtual machine comprises:
determining a service identifier corresponding to the source virtual machine, wherein the service identifier is used for representing a service running on the source virtual machine;
creating a snapshot for the volume of the source virtual machine, and saving the service identifier as the description information of the snapshot.
4. A method of virtual machine management, comprising:
receiving a virtual machine identifier of a destination virtual machine sent by a destination host, wherein the destination virtual machine is a virtual machine which is generated by the destination host according to a new volume transmitted by a source host and is consistent with the configuration of the source virtual machine, and the new volume is generated according to a snapshot after the source host creates the snapshot on a volume of the source virtual machine;
associating, by the virtual machine identifier, operating data of the destination virtual machine, the operating data including metadata of the destination virtual machine and at least one of authority data and order data of the destination virtual machine;
and synchronously updating each item of running data associated with the virtual machine identifier.
5. The method of virtual machine management according to claim 4, wherein prior to said identifying, by the virtual machine, the operational data associated with the destination virtual machine, further comprising:
and acquiring the state information of the target virtual machine by adopting a polling mechanism until the service on the target virtual machine is started.
6. A server, comprising:
the snapshot unit is used for creating a snapshot for the volume of the source virtual machine;
a creating unit configured to create a new volume according to the snapshot;
and the transfer unit is used for transferring the new volume to a destination host, and the new volume is used for generating a destination virtual machine consistent with the configuration of the source virtual machine by the destination host.
7. A server, comprising:
a receiving unit, configured to receive a virtual machine identifier of a destination virtual machine sent by a destination host, where the destination virtual machine is a virtual machine that is generated by the destination host according to a new volume transmitted by a source host and is consistent with a configuration of the source virtual machine, and the new volume is generated by the source host after creating a snapshot for a volume of the source virtual machine and then generating according to the snapshot;
the association unit is used for associating the running data of the target virtual machine through the virtual machine identifier, wherein the running data comprises metadata of the target virtual machine and at least one of authority data and order data of the target virtual machine;
and the synchronization unit is used for synchronously updating each item of running data associated with the virtual machine identifier.
8. A server, comprising:
a receiver, a transmitter, a processor and a storage medium storing processor-executable instructions, received data of the receiver and transmitted data of the transmitter, the receiver, the transmitter and the storage medium relying on the processor to perform operations via a communication bus, the instructions when executed by the processor performing the method of virtual machine migration according to any of the preceding claims 1 to 3.
9. A server, comprising:
receiver, sender, processor and storage medium storing said processor executable instructions, data received by said receiver and data sent by said sender, said receiver, said sender and storage medium relying on said processor to perform operations via a communication bus, said instructions when executed by a processor performing the method of virtual machine management according to claim 4 or 5 above.
10. A computer-readable storage medium storing machine instructions which, when executed by one or more processors, perform a method of virtual machine migration as claimed in any one of claims 1 to 3 or a method of virtual machine management as claimed in claim 4 or 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910839256.4A CN112445571A (en) | 2019-09-05 | 2019-09-05 | Virtual machine migration and management method, server and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910839256.4A CN112445571A (en) | 2019-09-05 | 2019-09-05 | Virtual machine migration and management method, server and computer readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112445571A true CN112445571A (en) | 2021-03-05 |
Family
ID=74733102
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910839256.4A Pending CN112445571A (en) | 2019-09-05 | 2019-09-05 | Virtual machine migration and management method, server and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112445571A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115065630A (en) * | 2022-05-10 | 2022-09-16 | 深信服科技股份有限公司 | Virtual router migration method and device, electronic equipment and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103729237A (en) * | 2014-01-07 | 2014-04-16 | 浪潮(北京)电子信息产业有限公司 | Method for transferring virtual machine across storage pools |
| US20160231944A1 (en) * | 2015-02-05 | 2016-08-11 | Red Hat, Inc. | Peer to peer volume merge and delete in a shared storage environment |
| CN107247619A (en) * | 2017-06-12 | 2017-10-13 | 上海优刻得信息科技有限公司 | Live migration of virtual machine method, device, system, storage medium and equipment |
-
2019
- 2019-09-05 CN CN201910839256.4A patent/CN112445571A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103729237A (en) * | 2014-01-07 | 2014-04-16 | 浪潮(北京)电子信息产业有限公司 | Method for transferring virtual machine across storage pools |
| US20160231944A1 (en) * | 2015-02-05 | 2016-08-11 | Red Hat, Inc. | Peer to peer volume merge and delete in a shared storage environment |
| CN107247619A (en) * | 2017-06-12 | 2017-10-13 | 上海优刻得信息科技有限公司 | Live migration of virtual machine method, device, system, storage medium and equipment |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115065630A (en) * | 2022-05-10 | 2022-09-16 | 深信服科技股份有限公司 | Virtual router migration method and device, electronic equipment and storage medium |
| CN115065630B (en) * | 2022-05-10 | 2024-04-09 | 深信服科技股份有限公司 | Migration method and device of virtual router, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109542611B (en) | Database-as-a-service system, database scheduling method, device and storage medium | |
| CN102594849B (en) | Data backup and recovery method and device, virtual machine snapshot deleting and rollback method and device | |
| CN110247984B (en) | Service processing method, device and storage medium | |
| US11422843B2 (en) | Virtual machine migration method and apparatus having automatic user registration at a destination virtual machine | |
| CN106528224A (en) | Content updating method and system for Docker container, and server | |
| CN111651305B (en) | Virtual machine backup method, virtual machine backup assembly and cloud computing system | |
| US11188347B2 (en) | Virtual function driver loading method and server using global and local identifiers corresponding to locations of the virtual functions | |
| CN108073423B (en) | Accelerator loading method and system and accelerator loading device | |
| CN112445570A (en) | Cloud platform resource migration method and device and storage medium | |
| CN111897558A (en) | Kubernets upgrading method and device for container cluster management system | |
| EP3879875A1 (en) | Resource change method and device, apparatus, and storage medium | |
| CN111800468A (en) | Cloud-based multi-cluster management method, device, medium and electronic equipment | |
| CN111104201A (en) | System migration method and device, electronic equipment and storage medium | |
| CN111787126A (en) | Container creation method, server, and storage medium | |
| CN107656796B (en) | Virtual machine cold migration method, system and equipment | |
| CN115048181A (en) | Heat deployment method and device based on Kubernetes container cloud platform and application | |
| CN107783826B (en) | Virtual machine migration method, device and system | |
| CN112445571A (en) | Virtual machine migration and management method, server and computer readable storage medium | |
| CN111338751B (en) | Cross-pool migration method and device for data in same ceph cluster | |
| CN111722909A (en) | Virtual machine migration method, system, equipment and storage medium | |
| WO2022127583A1 (en) | Virtual machine control method, cloud management device and storage medium | |
| CN109739615B (en) | Mapping method and device of virtual hard disk and cloud computing platform | |
| CN109120588B (en) | Method for acquiring verification information and data center | |
| CN112181278B (en) | Method, device, equipment and storage medium for creating system disk in cloud computing system | |
| CN112711469A (en) | Cloud host migration method and device, computer equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20210305 |