CN111756800A - Method and system for processing burst flow - Google Patents
Method and system for processing burst flow Download PDFInfo
- Publication number
- CN111756800A CN111756800A CN202010434481.2A CN202010434481A CN111756800A CN 111756800 A CN111756800 A CN 111756800A CN 202010434481 A CN202010434481 A CN 202010434481A CN 111756800 A CN111756800 A CN 111756800A
- Authority
- CN
- China
- Prior art keywords
- virtual machine
- target
- service server
- service
- latest
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/60—Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/60—Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources
- H04L67/61—Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources taking into account QoS or priority requirements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
- G06F2009/45562—Creating, deleting, cloning virtual machine instances
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
- G06F2009/45595—Network integration; Enabling network access in virtual machine instances
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Stored Programmes (AREA)
Abstract
The invention discloses a method and a system for processing burst flow, and belongs to the technical field of network communication. The method comprises the following steps: respectively creating corresponding template virtual machines aiming at various services; deploying latest business software and configuration data on each template virtual machine; acquiring and storing the latest mirror image snapshot generated by each template virtual machine; and when the flow is burst, a service server based on the virtual machine is established based on the latest mirror image snapshot, and the burst flow is led into the service server based on the virtual machine. By adopting the invention, the creation efficiency of the service server based on the virtual machine can be ensured, and the traffic burst can be quickly and effectively relieved, thereby ensuring the service quality of the CDN system.
Description
Technical Field
The present invention relates to the field of network communication technologies, and in particular, to a method and a system for processing burst traffic.
Background
The CDN cluster enables the user terminals in each region to acquire required service data from the cache server of the edge node nearby by deploying the edge node in different regions, so as to improve the response speed of the service. In the edge node, the user traffic of different services may be served by a cache server deployed with different service software, and specifically may include an on-demand cache server, a picture cache server, a live broadcast cache server, and the like.
A CDN customer (i.e., a service provider that provides CDN acceleration services) may cause a sudden phenomenon in user traffic of a relevant cache server due to a promotion activity, a hot event, and the like. Therefore, the CDN cluster may select an edge node (which may be referred to as a burst node) at which traffic bursts easily occur, and pre-deploy a backup cache server at the burst node to form a redundant resource pool. In this way, once a traffic burst occurs in a certain service, the CDN cluster may import the user traffic into the standby cache server to quickly cope with the traffic burst.
In the process of implementing the invention, the inventor finds that the prior art has at least the following problems:
before the standby cache server is used for dealing with the traffic burst, business software and configuration data need to be deployed on the standby cache server, and if the traffic burst is detected, the standby cache server is deployed, so that the processes of server shelving, software installation environment initialization, software deployment, remote configuration deployment and the like are included in the deployment of the standby cache server, and the time is long, so that the traffic burst cannot be dealt with in time. If the deployment is carried out in advance, on one hand, because different service cache servers cannot be used in a mixed manner, for example, the flow of the on-demand user can only be processed by the on-demand cache server, and the different service burst requirements can be met only by deploying the cache servers of multiple services in the burst node at the same time; on the other hand, traffic bursts of different service types generally do not occur simultaneously, so that the situations that part of cache servers are busy and part of cache servers are idle exist, and therefore, server resources are wasted.
Disclosure of Invention
In order to solve the problems in the prior art, embodiments of the present invention provide a method and a system for processing bursty traffic. The technical scheme is as follows:
in a first aspect, a method for processing bursty traffic is provided, where the method includes:
respectively creating corresponding template virtual machines aiming at various services;
deploying latest business software and configuration data on each template virtual machine;
acquiring and storing the latest mirror image snapshot generated by each template virtual machine;
and when the flow is burst, a service server based on the virtual machine is established based on the latest mirror image snapshot, and the burst flow is led into the service server based on the virtual machine.
In a second aspect, a system for processing bursty traffic is provided, where the system includes a central node and an edge node, and the central node includes a scheduling management component, a virtual machine management component, and a software deployment component, where:
the virtual machine management component is used for respectively creating corresponding template virtual machines aiming at various services;
the software management component is used for deploying latest business software and configuration data on each template virtual machine;
the virtual machine management component is also used for acquiring and storing the latest mirror image snapshot generated by each template virtual machine;
and the virtual machine management component is also used for creating a virtual machine-based service server based on the latest mirror image snapshot when the flow is burst, and triggering the scheduling management component to lead burst flow into the virtual machine-based service server.
In a third aspect, a node device is provided, which includes a processor and a memory, where at least one instruction, at least one program, a set of codes, or a set of instructions is stored in the memory, and the at least one instruction, the at least one program, the set of codes, or the set of instructions is loaded and executed by the processor to implement the method for processing bursty traffic according to the first aspect.
In a fourth aspect, there is provided a computer readable storage medium having stored therein at least one instruction, at least one program, set of codes, or set of instructions, which is loaded and executed by a processor to implement the method of handling bursty traffic as set forth in the first aspect.
The technical scheme provided by the embodiment of the invention has the following beneficial effects:
in the embodiment of the invention, corresponding template virtual machines are respectively created for various services; deploying latest business software and configuration data on each template virtual machine; acquiring and storing the latest mirror image snapshots generated by the template virtual machines; and when the flow is burst, a service server based on the virtual machine is established based on the latest mirror image snapshot, and the burst flow is led into the service server based on the virtual machine. Therefore, the template virtual machines corresponding to different services are utilized to generate the mirror image snapshots of the operating environments of the service software in advance, and when the traffic is sudden, the service server based on the virtual machine is established based on the mirror image snapshots to deal with the traffic, so that the establishing efficiency of the service server based on the virtual machine can be ensured, the traffic sudden can be relieved quickly and effectively, and the service quality of the CDN system can be ensured.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic structural diagram of a system for processing bursty traffic according to an embodiment of the present invention;
fig. 2 is a flowchart illustrating a method for processing burst traffic according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of a node device according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, embodiments of the present invention will be described in detail with reference to the accompanying drawings. The embodiment of the invention provides a method for processing burst flow, which can be applied to a CDN system and mainly can be realized by a central node of the CDN system. The central node may be configured to manage edge nodes of the CDN cluster, for example, monitor a device running state of the edge node, control the edge node to perform service upgrade and update, and implement load balancing of the edge node. The central node may include multiple components such as a scheduling management component, a virtual machine management component, and a software deployment component, and the management of the edge node is realized by the multiple components together. The scheduling management component, the virtual machine management component and the software deployment component can be deployed at each edge node of the CDN system by using a distributed architecture, so as to facilitate data acquisition and instruction issue. In this embodiment, the scheduling management component may be mainly used for planning physical resources and scheduling service traffic, the virtual machine management component may be mainly used for creating and deleting virtual resources for each edge node, and the software deployment component may be mainly used for storing and maintaining service software and configuration data. The specific scenario architecture described above may be as shown in fig. 1.
The process flow shown in fig. 2 will be described in detail below with reference to the specific embodiments, and the contents may be as follows:
In implementation, an edge node of the CDN system may provide, to the outside, a cache service of multiple services, such as a unicast service, a direct broadcast service, a picture service, and the like. For these services, the virtual machine management component of the central node of the CDN system may create a template virtual machine corresponding to each service. The template virtual machine can be created based on a small amount of device resources of a real physical server, is used for running a virtual server of business software, and is only used for simulating a software running environment and is not used for providing business services to the outside.
Optionally, the redundant resources may be planned in advance according to the traffic emergency of each edge node, and the corresponding processing may be as follows: and planning a corresponding redundant resource pool for each edge node based on the historical traffic burst record of each edge node.
In implementation, when the edge node provides the CDN acceleration service to the outside, the edge node may record the traffic burst of the node, generate a historical traffic burst record of the node, and upload the historical traffic burst record to the central node. The dispatching management component of the central node can analyze the redundant resource requirements of each edge node by utilizing the historical flow burst records of each edge node, so that a redundant resource pool can be planned for each edge node. The redundant resource pool may be formed by real physical device resources deployed at the edge node, and is mainly used for creating a virtual machine-based service server at the edge node to deal with traffic emergency. When a certain edge node generates a traffic burst, a relevant virtual machine-based service server can be established by using a corresponding redundant resource pool; each redundant resource pool can serve at least one edge node, namely, the redundant resource pool is deployed at a certain edge node and can simultaneously serve the edge node and a plurality of adjacent edge nodes. It can be understood that, when planning a redundant resource pool, the redundant resource pool may be preferentially deployed at an edge node with a higher traffic burst frequency, and when a small amount of traffic burst occurs at other edge nodes adjacent to the edge node, the redundant resource pool may be used to temporarily handle the current traffic burst without additionally planning a new redundant resource pool for each edge node.
Optionally, template virtual machines may be respectively created for different edge nodes, and corresponding processing may be as follows: and respectively creating template virtual machines corresponding to various services based on the server parameters of the target edge node aiming at various services supported by the target edge node.
In implementation, taking a target edge node as an example, the virtual machine management component may first determine multiple services supported by the target edge node, and obtain server parameters of the target edge node. Then, the virtual machine management component may create, for each service, a template virtual machine corresponding to each service at the target edge node based on the server parameter of the target edge node. It can be understood that the running environments of the same service software on different servers may be different, so that creating the template virtual machine with the edge node as the granularity can make the mirror snapshot generated by the template virtual machine more match the device environment required by the traffic at the edge node.
In implementation, after the template virtual machine is created for each service, the virtual machine management component of the central node may synchronize device information of the template virtual machine to the software deployment component, where the device information may specifically include a virtual machine ID, an IP address, a service type, and the like. After the software deployment component of the central node acquires the device information, the latest service software and configuration data corresponding to each service can be read from the database, and then the corresponding latest service software and configuration data are deployed on each template virtual machine, for example, on-demand type cache software is deployed on an on-demand type template virtual machine, and live type cache software is deployed on a live type template virtual machine.
Optionally, the central node needs to periodically update the service software and configuration data on the template virtual machine, and accordingly, the processing in step 202 may be as follows: when a software updating request of the target service is received, or after the target service is detected to finish version updating, the latest service software and configuration data of the target service are deployed on the template virtual machine corresponding to the target service again.
In implementation, after version update and upgrade are performed on the service software on the cache server by the CDN system, a corresponding software update request may be sent to the software deployment component of the central node. The software deployment component of the central node may obtain the latest software data package based on the received software update request of the target service, and then redeploy the latest service software and configuration data of the target service on the template virtual machine corresponding to the target service. Or, the software deployment component of the central node may actively monitor the version update condition of the service, and when it is detected that the version update of the target service is completed, the software deployment component may redeploy the latest service software and configuration data of the target service on the template virtual machine corresponding to the target service.
And step 203, acquiring and storing the latest mirror image snapshot generated by each template virtual machine.
In implementation, each time the software configuration is completed on each template virtual machine, the software deployment component of the central node may send a software configuration completion signal to the virtual machine management component. Furthermore, the virtual machine management component may send an image generation instruction to each template virtual machine to trigger the template virtual machine to generate a latest image snapshot, that is, the template virtual machine removes configuration information and log information that are related to machine characteristics (e.g., template IP, MAC, etc.) in the original image file system and that are required to be read by the original service software, and regenerates the latest image according to the configuration file related to the latest machine characteristics. Next, the virtual machine management component may obtain and store the latest image snapshot.
Optionally, after the software is redeployed on the template virtual machine, the stored mirror snapshot may be updated, and accordingly, the processing of step 203 may be as follows: after the target template virtual machine completes redeployment processing, sending a mirror image snapshot updating request to the target template virtual machine; and storing the latest image snapshot generated by the target template virtual machine at the edge node, and deleting the historical image snapshot of the target template virtual machine.
In implementation, after the software deployment component of the central node redeploys the service software and the configuration data in the target template virtual machine, a software configuration completion signal may be sent to the virtual machine management component. Thereafter, the virtual machine management component may send a mirror snapshot update request to the target template virtual machine to trigger each template virtual machine to regenerate the mirror snapshot. After the template virtual machine generates the latest image snapshot, the virtual machine management component may store the latest image snapshot generated by the target template virtual machine at the edge node and delete the historical image snapshot of the target template virtual machine. It can be understood that the image snapshot generated by the template virtual machine is stored on the edge node, and the image snapshot can be quickly called when the service server based on the virtual machine is created, so as to shorten the creation time of the service server based on the virtual machine and improve the response efficiency of traffic bursts.
And step 204, when the flow is burst, a service server based on the virtual machine is established based on the latest mirror image snapshot, and the burst flow is led into the service server based on the virtual machine.
In implementation, when a traffic burst occurs in the CDN system, the scheduling management component of the central node may send a redundant resource request to the virtual machine management component. The virtual management component may obtain the redundant resource request, call the stored corresponding latest mirror snapshot to create a virtual machine-based service server, so as to handle the current traffic burst. After the virtual machine-based service server is created, the virtual machine management component may synchronize the device information of the virtual machine-based service server with the scheduling management component, so that the scheduling management component may introduce the burst traffic into the newly created virtual machine-based service server. Here, for the import processing of the burst traffic, the service server based on the virtual machine may be added to the original service server group, and then all the service traffic is distributed to all the service servers including the service server based on the virtual machine in a balanced manner; or the service flow can be preferentially distributed to the original service server, and then the exceeding service flow is led into the service server based on the virtual machine.
Optionally, a virtual machine-based service server may be created when a traffic burst occurs or within a preset time period, and correspondingly, the processing in step 204 may be as follows: when the target edge node has a traffic burst of a target service or is in a preset traffic burst high-frequency period of the target service, acquiring a latest mirror image snapshot of a template virtual machine corresponding to the target service; and based on the redundant resource pool corresponding to the target edge node and the latest mirror image snapshot, creating a target virtual machine-based service server, and importing the burst flow of the target service into the target virtual machine-based service server.
In an implementation, the central node's schedule management component may distribute and detect traffic on edge nodes. When detecting that a traffic burst of a target service occurs at a target edge node, the scheduling management component may send a virtual machine creation request to the virtual machine management component. The virtual machine management component can obtain the latest mirror image snapshot of the template virtual machine corresponding to the target service, and then creates a target virtual machine-based service server on the redundant resource pool corresponding to the target edge node by using the latest mirror image snapshot. And the virtual machine management component can return the equipment information of the target virtual machine-based service server to the scheduling management component, so that the scheduling management component can introduce the burst flow of the target service into the target virtual machine-based service server according to the equipment information of the target virtual machine-based service server.
Meanwhile, the central node may count traffic burst conditions of each service on each edge node, and then determine a traffic burst high-frequency time period, that is, a time period in which traffic bursts frequently occur, of each service on each edge node according to the statistical result. Therefore, when the traffic burst high-frequency period of the preset target service exists, the virtual machine management component can automatically acquire the latest mirror image snapshot of the template virtual machine corresponding to the target service, and then on the redundant resource pool corresponding to the target edge node, the latest mirror image snapshot is used for creating the target virtual machine-based service server. And the virtual machine management component can return the equipment information of the target virtual machine-based service server to the scheduling management component, so that the scheduling management component can introduce the burst flow of the target service into the target virtual machine-based service server according to the equipment information of the target virtual machine-based service server.
Optionally, if the available device resources in the redundant resource pool are not enough, the existing service server based on the virtual machine may be deleted to release the device resources, and the corresponding processing may be as follows: detecting whether equipment resources required by a target virtual machine-based service server exist in a redundant resource pool corresponding to a target edge node; and if the service type does not exist, deleting the service server based on the virtual machine corresponding to the service type with the lowest priority in the redundant resource pool, and releasing the equipment resources of the service server based on the virtual machine.
In implementation, when creating a virtual machine-based service server for a burst traffic of a target edge node, a virtual machine management component may first detect whether an equipment resource required by the target virtual machine-based service server exists in a redundant resource pool corresponding to the target edge node. If the device resource does not exist, it indicates that the device resource in the current redundant resource pool is largely occupied, at this time, the virtual machine management component may select the service type with the lowest priority, then delete the virtual machine-based service server corresponding to the service type, and release the device resource of the virtual machine-based service server. Of course, if there is no virtual machine-based service server corresponding to the service type with the lowest priority, the virtual machine-based service server with the lowest priority of the corresponding service type may be deleted from all the virtual machine-based service servers established based on the redundant resource pool.
Optionally, if the available device resources of the redundant resource pool are not enough, a virtual machine-based service server may be established on an adjacent redundant resource pool, and the corresponding processing may be as follows: detecting whether equipment resources required by a target virtual machine-based service server exist in a redundant resource pool corresponding to a target edge node; and if the target edge node does not exist, establishing a target virtual machine-based service server based on the latest redundant resource pool and the latest mirror image snapshot of the target edge node, and introducing the burst flow into the target virtual machine-based service server.
In implementation, when creating a virtual machine-based service server for a burst traffic of a target edge node, a virtual machine management component may first detect whether an equipment resource required by the target virtual machine-based service server exists in a redundant resource pool corresponding to the target edge node. If the virtual machine management component does not exist, it indicates that the equipment resources in the current redundant resource pool are occupied in large quantity, at this time, the virtual machine management component can select the redundant resource pool closest to the target edge node according to the network address and the physical address of the target edge node, and then create the target virtual machine-based service server based on the redundant resource pool and the latest mirror image snapshot of the target service. And the virtual machine management component can return the equipment information of the target virtual machine-based service server to the scheduling management component, so that the scheduling management component can introduce the burst flow of the target service into the target virtual machine-based service server according to the equipment information of the target virtual machine-based service server.
Optionally, after detecting that the traffic burst is ended and is not in the preset traffic burst high-frequency period, deleting the service server based on the virtual machine, and releasing the device resource of the service server based on the virtual machine.
In implementation, when the scheduling management node of the central node schedules and distributes the burst traffic of the edge node, if it is detected that the traffic burst is over (specifically, when the traffic is lower than a preset traffic threshold for a long time, it is considered that the traffic burst is over), it may be further determined whether the current time belongs to a preset traffic burst high-frequency period. It is understood that the traffic burst high frequency period corresponds to the edge node and the service type, and the traffic burst high frequency periods of different service types of different edge nodes may be the same or different. If the current time is not in the flow burst high-frequency period, the scheduling management component can send a virtual machine release instruction to the virtual machine management component, so that the virtual machine management component can delete the service server based on the virtual machine and release the equipment resources of the service server based on the virtual machine.
Optionally, the creating process of the service server based on the virtual machine may also be used to deal with a server failure, and the corresponding process may be as follows: when the cache server for detecting the target service type at the target edge node fails, a target virtual machine-based service server is created based on the redundant resource pool and the latest mirror image snapshot corresponding to the target edge node, and the flow of the target service is led into the target virtual machine-based service server.
In implementation, when the scheduling management component of the central node schedules and distributes traffic of the target edge node, if it is detected that the cache server of the target service type at the target edge node fails, a virtual machine creation request may be sent to the virtual machine management component. Furthermore, the virtual machine management component can call the latest mirror image snapshot corresponding to the target service type, and then create the target virtual machine-based service server based on the redundant resource pool corresponding to the target edge node. And the virtual machine management component can return the equipment information of the target virtual machine-based service server to the scheduling management component, so that the scheduling management component can lead the flow of the target service to the target virtual machine-based service server according to the equipment information of the target virtual machine-based service server.
In the embodiment of the invention, corresponding template virtual machines are respectively created for various services; deploying latest business software and configuration data on each template virtual machine; acquiring and storing the latest mirror image snapshots generated by the template virtual machines; and when the flow is burst, a service server based on the virtual machine is established based on the latest mirror image snapshot, and the burst flow is led into the service server based on the virtual machine. Therefore, the template virtual machines corresponding to different services are utilized to generate the mirror image snapshots of the operating environments of the service software in advance, and when the traffic is sudden, the service server based on the virtual machine is established based on the mirror image snapshots to deal with the traffic, so that the establishing efficiency of the service server based on the virtual machine can be ensured, the traffic sudden can be relieved quickly and effectively, and the service quality of the CDN system can be ensured.
Based on the same technical concept, an embodiment of the present invention further provides a system for processing bursty traffic, as shown in fig. 1, the system includes a central node and an edge node, the central node includes a scheduling management component, a virtual machine management component, and a software deployment component, where:
the virtual machine management component is used for respectively creating corresponding template virtual machines aiming at various services;
the software management component is used for deploying latest business software and configuration data on each template virtual machine;
the virtual machine management component is also used for acquiring and storing the latest mirror image snapshot generated by each template virtual machine;
and the virtual machine management component is also used for creating a virtual machine-based service server based on the latest mirror image snapshot when the flow is burst, and triggering the scheduling management component to lead burst flow into the virtual machine-based service server.
Optionally, the schedule management component is further configured to:
and planning a corresponding redundant resource pool for each edge node based on the historical flow burst record of each edge node, wherein the redundant resource pool is used for providing real physical equipment resources for a service server based on a virtual machine, each edge node corresponds to one redundant resource pool, and each redundant resource pool serves at least one edge node.
Optionally, the virtual machine management component is further configured to:
detecting whether equipment resources required by a target virtual machine-based service server exist in a redundant resource pool corresponding to a target edge node;
and if the service type does not exist, deleting the service server based on the virtual machine corresponding to the service type with the lowest priority in the redundant resource pool, and releasing the equipment resources of the service server based on the virtual machine.
Fig. 3 is a schematic structural diagram of a node device according to an embodiment of the present invention. The node apparatus 300 may vary significantly due to configuration or performance differences and may include one or more central processors 322 (e.g., one or more processors) and memory 332, one or more storage media 330 (e.g., one or more mass storage devices) storing applications 342 or data 344. Memory 332 and storage media 330 may be, among other things, transient storage or persistent storage. The program stored in storage medium 330 may include one or more modules (not shown), each of which may include a sequence of instructions operating on node device 300. Still further, the central processor 322 may be configured to communicate with the storage medium 330 to execute a series of instruction operations in the storage medium 330 on the node device 300.
It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, where the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.
Claims (13)
1. A method for handling bursty traffic, the method comprising:
respectively creating corresponding template virtual machines aiming at various services;
deploying latest business software and configuration data on each template virtual machine;
acquiring and storing the latest mirror image snapshot generated by each template virtual machine;
and when the flow is burst, a service server based on the virtual machine is established based on the latest mirror image snapshot, and the burst flow is led into the service server based on the virtual machine.
2. The method of claim 1, further comprising:
and planning redundant resource pools for the edge nodes based on historical flow burst records of the edge nodes, wherein the redundant resource pools are used for providing real physical equipment resources for the service server based on the virtual machine, and each redundant resource pool serves at least one edge node.
3. The method of claim 1, wherein deploying the latest business software and configuration data on each of the template virtual machines comprises:
when a software updating request of a target service is received, or after the completion of the version updating of the target service is detected, the latest service software and configuration data of the target service are deployed on the template virtual machine corresponding to the target service again.
4. The method according to claim 1, wherein the obtaining and storing the latest image snapshot generated by each template virtual machine comprises:
after the target template virtual machine completes redeployment processing, sending a mirror image snapshot updating request to the target template virtual machine;
and storing the latest image snapshot generated by the target template virtual machine at an edge node, and deleting the historical image snapshot of the target template virtual machine.
5. The method according to claim 2, wherein the creating a virtual machine-based service server based on the latest mirror snapshot when the traffic is bursty, and the importing the bursty traffic to the virtual machine-based service server comprises:
when the target edge node has a traffic burst of a target service or is in a preset traffic burst high-frequency period of the target service, acquiring a latest mirror image snapshot of a template virtual machine corresponding to the target service;
and establishing a target virtual machine-based service server based on the redundant resource pool corresponding to the target edge node and the latest mirror image snapshot, and importing the burst flow of the target service into the target virtual machine-based service server.
6. The method according to claim 5, wherein before creating the target virtual machine-based service server corresponding to the target service based on the latest mirror snapshot of the template virtual machine corresponding to the target service, the method further comprises:
detecting whether equipment resources required by the target virtual machine-based service server exist in a redundant resource pool corresponding to the target edge node;
and if the service type does not exist, deleting the service server based on the virtual machine corresponding to the service type with the lowest priority in the redundant resource pool, and releasing the equipment resources of the service server based on the virtual machine.
7. The method according to claim 5, wherein the creating a target virtual machine-based service server corresponding to the target service based on the latest mirror snapshot of the template virtual machine corresponding to the target service comprises:
detecting whether equipment resources required by the target virtual machine-based service server exist in a redundant resource pool corresponding to the target edge node;
and if the target edge node does not exist, establishing a target virtual machine-based service server based on the latest redundant resource pool of the target edge node and the latest mirror image snapshot, and introducing the burst flow into the target virtual machine-based service server.
8. The method of claim 1, wherein after the directing the burst traffic to the virtual machine-based service server, further comprising:
and deleting the service server based on the virtual machine and releasing the equipment resources of the service server based on the virtual machine after detecting that the flow burst is finished and is not in a preset flow burst high-frequency period.
9. The method according to claim 1, wherein the creating the corresponding template virtual machine for each of the plurality of services comprises:
and respectively creating template virtual machines corresponding to various services based on the server parameters of the target edge node aiming at the various services supported by the target edge node.
10. The method of claim 1, further comprising:
when a cache server for detecting the type of the target service at the target edge node fails, a target virtual machine-based service server is created based on a redundant resource pool corresponding to the target edge node and the latest mirror image snapshot, and the flow of the target service is led into the target virtual machine-based service server.
11. A system for processing bursty traffic, the system comprising a central node and an edge node, the central node comprising a schedule management component, a virtual machine management component, and a software deployment component, wherein:
the virtual machine management component is used for respectively creating corresponding template virtual machines aiming at various services;
the software management component is used for deploying latest business software and configuration data on each template virtual machine;
the virtual machine management component is also used for acquiring and storing the latest mirror image snapshot generated by each template virtual machine;
and the virtual machine management component is also used for creating a virtual machine-based service server based on the latest mirror image snapshot when the flow is burst, and triggering the scheduling management component to lead burst flow into the virtual machine-based service server.
12. A node device, characterized in that it comprises a processor and a memory, in which at least one instruction, at least one program, set of codes or set of instructions is stored, which is loaded and executed by the processor to implement the method of handling bursty traffic as claimed in any one of claims 1 to 10.
13. A computer readable storage medium having stored therein at least one instruction, at least one program, a set of codes, or a set of instructions, which is loaded and executed by a processor to implement a method of handling bursty traffic as claimed in any one of claims 1 to 10.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010434481.2A CN111756800A (en) | 2020-05-21 | 2020-05-21 | Method and system for processing burst flow |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010434481.2A CN111756800A (en) | 2020-05-21 | 2020-05-21 | Method and system for processing burst flow |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111756800A true CN111756800A (en) | 2020-10-09 |
Family
ID=72673467
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010434481.2A Pending CN111756800A (en) | 2020-05-21 | 2020-05-21 | Method and system for processing burst flow |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111756800A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112437124A (en) * | 2020-11-09 | 2021-03-02 | 北京金山云网络技术有限公司 | Method and device for processing flow mirror image request and load balancing server |
| CN115297124A (en) * | 2022-07-25 | 2022-11-04 | 天翼云科技有限公司 | System operation and maintenance management method and device and electronic equipment |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102801550A (en) * | 2011-05-27 | 2012-11-28 | 北京邮电大学 | Management method and device for content delivery network |
| CN102801792A (en) * | 2012-07-26 | 2012-11-28 | 华南理工大学 | Statistical-prediction-based automatic cloud CDN (Content Delivery Network) resource automatic deployment method |
| CN103259739A (en) * | 2012-02-15 | 2013-08-21 | 株式会社日立制作所 | Load balancing device and load balancing method |
| WO2017050036A1 (en) * | 2015-09-23 | 2017-03-30 | 中兴通讯股份有限公司 | Resource allocation information transmission and data distribution method and device |
| CN108768877A (en) * | 2018-07-20 | 2018-11-06 | 网宿科技股份有限公司 | A kind of distribution method of burst flow, device and proxy server |
| CN109525414A (en) * | 2017-09-20 | 2019-03-26 | 中兴通讯股份有限公司 | The management method of CDN network virtualization of function, apparatus and system |
-
2020
- 2020-05-21 CN CN202010434481.2A patent/CN111756800A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102801550A (en) * | 2011-05-27 | 2012-11-28 | 北京邮电大学 | Management method and device for content delivery network |
| CN103259739A (en) * | 2012-02-15 | 2013-08-21 | 株式会社日立制作所 | Load balancing device and load balancing method |
| CN102801792A (en) * | 2012-07-26 | 2012-11-28 | 华南理工大学 | Statistical-prediction-based automatic cloud CDN (Content Delivery Network) resource automatic deployment method |
| WO2017050036A1 (en) * | 2015-09-23 | 2017-03-30 | 中兴通讯股份有限公司 | Resource allocation information transmission and data distribution method and device |
| CN109525414A (en) * | 2017-09-20 | 2019-03-26 | 中兴通讯股份有限公司 | The management method of CDN network virtualization of function, apparatus and system |
| CN108768877A (en) * | 2018-07-20 | 2018-11-06 | 网宿科技股份有限公司 | A kind of distribution method of burst flow, device and proxy server |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112437124A (en) * | 2020-11-09 | 2021-03-02 | 北京金山云网络技术有限公司 | Method and device for processing flow mirror image request and load balancing server |
| CN115297124A (en) * | 2022-07-25 | 2022-11-04 | 天翼云科技有限公司 | System operation and maintenance management method and device and electronic equipment |
| CN115297124B (en) * | 2022-07-25 | 2023-08-04 | 天翼云科技有限公司 | System operation and maintenance management method and device and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113296792B (en) | Storage method, device, equipment, storage medium and system | |
| CN109656742B (en) | Node exception handling method and device and storage medium | |
| CN116566984B (en) | Routing information creation method and device of k8s container cluster and electronic equipment | |
| CN112463290A (en) | Method, system, apparatus and storage medium for dynamically adjusting the number of computing containers | |
| CN111756800A (en) | Method and system for processing burst flow | |
| CN111399764A (en) | Data storage method, data reading device, data storage equipment and data storage medium | |
| CN111541762B (en) | Data processing method, management server, device and storage medium | |
| CN110138753B (en) | Distributed message service system, method, apparatus, and computer-readable storage medium | |
| CN110196749B (en) | Virtual machine recovery method and device, storage medium and electronic device | |
| CN106911741B (en) | Method for balancing virtual network management file downloading load and network management server | |
| CN112261125B (en) | Centralized unit cloud deployment method, device and system | |
| US20240054054A1 (en) | Data Backup Method and System, and Related Device | |
| CN111897551B (en) | Platform and method for rapidly cloning software environment in cloud environment | |
| US20220206836A1 (en) | Method and Apparatus for Processing Virtual Machine Migration, Method and Apparatus for Generating Virtual Machine Migration Strategy, Device and Storage Medium | |
| CN106790354B (en) | Communication method and device for preventing data congestion | |
| CN115357198B (en) | Mounting method and device of storage volume, storage medium and electronic equipment | |
| CN111177160A (en) | Service updating method, device, server and medium | |
| CN114615268B (en) | Service network, monitoring node, container node and equipment based on Kubernetes cluster | |
| CN115225645A (en) | Service updating method, device, system and storage medium | |
| CN106302626A (en) | A kind of elastic expansion method, Apparatus and system | |
| CN114615263A (en) | Cluster online migration method, device, equipment and storage medium | |
| CN112153093B (en) | Cluster-based task scheduling method, device, equipment and readable storage medium | |
| CN115509676A (en) | Container set deployment method and device | |
| CN111431951B (en) | Data processing method, node equipment, system and storage medium | |
| CN110099208B (en) | Method and device for cross-level and cross-domain upgrading of camera in video monitoring system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |