CN116264538A - Data processing method, device, equipment and computer storage medium - Google Patents

Data processing method, device, equipment and computer storage medium Download PDF

Info

Publication number
CN116264538A
CN116264538A CN202210866290.2A CN202210866290A CN116264538A CN 116264538 A CN116264538 A CN 116264538A CN 202210866290 A CN202210866290 A CN 202210866290A CN 116264538 A CN116264538 A CN 116264538A
Authority
CN
China
Prior art keywords
vcpe
cluster
data processing
target
selectable
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210866290.2A
Other languages
Chinese (zh)
Inventor
何威
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Mobile Communications Group Co Ltd
China Mobile Suzhou Software Technology Co Ltd
Original Assignee
China Mobile Communications Group Co Ltd
China Mobile Suzhou Software Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Mobile Communications Group Co Ltd, China Mobile Suzhou Software Technology Co Ltd filed Critical China Mobile Communications Group Co Ltd
Priority to CN202210866290.2A priority Critical patent/CN116264538A/en
Publication of CN116264538A publication Critical patent/CN116264538A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/46—Interconnection of networks
    • H04L12/4633—Interconnection of networks using encapsulation techniques, e.g. tunneling
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/46—Interconnection of networks
    • H04L12/4641—Virtual LANs, VLANs, e.g. virtual private networks [VPN]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/06—Management of faults, events, alarms or notifications
    • H04L41/0654—Management of faults, events, alarms or notifications using network fault recovery
    • H04L41/0668—Management of faults, events, alarms or notifications using network fault recovery by dynamic selection of recovery network elements, e.g. replacement by the most appropriate element after failure
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/08—Configuration management of networks or network elements
    • H04L41/0803—Configuration setting
    • H04L41/0823—Configuration setting characterised by the purposes of a change of settings, e.g. optimising configuration for enhancing reliability
    • H04L41/0836—Configuration setting characterised by the purposes of a change of settings, e.g. optimising configuration for enhancing reliability to enhance reliability, e.g. reduce downtime
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
    • H04L67/1004—Server selection for load balancing
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00—Reducing energy consumption in communication networks
    • Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks

Abstract

The embodiment of the invention relates to the technical field of network communication and discloses a data processing method, which comprises the following steps: the method is based on an SD-WAN network; the SD-WAN network comprises a vcpe cluster; the vcpe cluster comprises a plurality of optional vcpe devices; the alternative vcpe devices are connected with each other; the method comprises the following steps: receiving a data processing request sent by a cpe device through a target vcpe device; the target vcpe device is one of the selectable vcpe devices; determining an available vcpe device from a plurality of selectable vcpe devices connected to the target vcpe device when the target vcpe device is not available; the data processing request is forwarded to the target virtual machine by the available vcpe device, and the target virtual machine is configured to process the data processing request. Through the mode, the availability of the SD-WAN network is improved.

Description

Data processing method, device, equipment and computer storage medium
Technical Field
The embodiment of the invention relates to the technical field of network communication, in particular to a data processing method, a device, equipment and a computer storage medium.
Background
With the rapid development of information technology, the demand for networks is increasing. SD-WAN, software defined wide area network, is a service formed by applying SDN technology to a wide area network scenario. The method is mainly applied to scenes such as an Internet data center and the like.
The inventors of the present application found in practicing the embodiments of the present invention that: the existing SD-WAN-based network has the problems of low availability and poor user experience.
Disclosure of Invention
In view of the above problems, an embodiment of the present invention provides a data processing method, which is used to solve the problem in the prior art that the availability of an SD-WAN network is low.
According to an aspect of an embodiment of the present invention, there is provided a data processing method, the method being based on an SD-WAN network; the SD-WAN network comprises a vcpe cluster; the vcpe cluster comprises a plurality of optional vcpe devices; the optional vcpe devices are connected with each other; the method comprises the following steps:
receiving a data processing request sent by a cpe device through a target vcpe device; the target vcpe device is one of the selectable vcpe devices;
determining an available vcpe device from a plurality of selectable vcpe devices connected to the target vcpe device when the target vcpe device is unavailable;
and forwarding the data processing request to a target virtual machine through the available vcpe equipment, wherein the target virtual machine is used for processing the data processing request.
In an alternative manner, the SD-WAN network further includes a virtual routing device; each selectable vcpe device is connected with the virtual routing device respectively; the virtual routing equipment is configured with routing information between each selectable vcpe equipment and a plurality of selectable virtual machines; the target virtual machine is one of the selectable virtual machines.
In an alternative, the method further comprises:
acquiring a vcpe cluster arrangement file sent by a user;
and configuring the vcpe cluster and the connection between the cpe equipment and the vcpe cluster according to the vcpe cluster arrangement file.
In an alternative, the method further comprises:
performing rule verification on the vcpe cluster arrangement file;
and when the verification is passed, configuring the vcpe cluster and the connection between the cpe equipment and the vcpe cluster according to the vcpe cluster arrangement file.
In an alternative, the method further comprises:
when the verification fails, determining a treatment strategy according to a preset rule base;
and updating the vcpe cluster arrangement file according to the disposal strategy.
In an alternative, the method further comprises:
analyzing the vcpe cluster arrangement file to obtain host information, external cluster network information and internal cluster network information corresponding to each piece of selectable vcpe equipment respectively;
establishing the selectable vcpe devices and a first tunnel between every two selectable vcpe devices according to the intra-cluster network information;
and establishing a second tunnel between the cpe device and each vcpe device according to the host information and the out-of-cluster network information.
In an alternative way, the second tunnel is established based on an elastic public network ip; and sharing bandwidth among the second tunnels.
According to another aspect of an embodiment of the present invention, there is provided a data processing apparatus including:
the receiving module is used for receiving a data processing request sent by the cpe device through the target vcpe device; the target vcpe device is one of the selectable vcpe devices;
a determining module, configured to determine, when the target vcpe device is unavailable, an available vcpe device from a plurality of selectable vcpe devices connected to the target vcpe device;
and the forwarding module is used for forwarding the data processing request to a target virtual machine through the available vcpe equipment, and the target virtual machine is used for processing the data processing request.
According to another aspect of an embodiment of the present invention, there is provided a data processing apparatus including: the device comprises a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface complete communication with each other through the communication bus;
the memory is configured to store at least one executable instruction that causes the processor to perform the operations of the data processing method according to any one of the foregoing embodiments.
According to yet another aspect of an embodiment of the present invention, there is provided a computer readable storage medium having stored therein at least one executable instruction for causing a data processing apparatus to perform the operations of the data processing method according to any one of the preceding embodiments.
The embodiment of the invention is based on an SD-WAN network; the SD-WAN network comprises a vcpe cluster; the vcpe cluster comprises a plurality of optional vcpe devices; the optional vcpe devices are connected with each other; according to the embodiment of the invention, the target vcpe equipment receives the data processing request sent by the cpe equipment; the target vcpe device is one of the selectable vcpe devices; determining an available vcpe device from a plurality of selectable vcpe devices connected to the target vcpe device when the target vcpe device is unavailable; and forwarding the data processing request to a target virtual machine through the available vcpe equipment, wherein the target virtual machine is used for processing the data processing request. According to the embodiment of the invention, the data processing request is forwarded and processed through the vcpe cluster which is fully interconnected in the virtual private cloud service, so that the availability of the SD-WAN network can be improved.
The foregoing description is only an overview of the technical solutions of the embodiments of the present invention, and may be implemented according to the content of the specification, so that the technical means of the embodiments of the present invention can be more clearly understood, and the following specific embodiments of the present invention are given for clarity and understanding.
Drawings
The drawings are only for purposes of illustrating embodiments and are not to be construed as limiting the invention. Also, like reference numerals are used to designate like parts throughout the figures. In the drawings:
FIG. 1 is a schematic flow chart of a data processing method according to an embodiment of the present invention;
FIG. 2 is a flow chart of a data processing method according to another embodiment of the present invention;
fig. 3 is a schematic networking diagram of a data processing method according to another embodiment of the present invention;
fig. 4 is a schematic diagram illustrating data transmission of a data processing method according to another embodiment of the present invention;
fig. 5 is a schematic diagram illustrating data transmission of a data processing method according to another embodiment of the present invention;
FIG. 6 is a schematic diagram of a data processing apparatus according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of a data processing apparatus according to an embodiment of the present invention.
Detailed Description
Exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present invention are shown in the drawings, it should be understood that the present invention may be embodied in various forms and should not be limited to the embodiments set forth herein.
Before proceeding with the description of the embodiments of the present invention, related terms will be described:
vpc: (Virtual Private Cloud ), i.e. an intranet virtualized on the cloud. An isolated and private virtual network environment is constructed for resources on a cloud such as a cloud server, a cloud container and a cloud database, and the safety, stability and high availability of the network are ensured by using a network virtualization technology through various technologies such as link redundancy, distributed gateway clusters, multi-AZ deployment and the like. Wherein a public cloud provider isolates certain parts of its public cloud infrastructure for private use. The VPC infrastructure is managed by public cloud providers, but the allocated resources are not shared with other customers.
CPE (Customer Premises Equipment, client device) refers to a network termination device located at the customer site for interfacing services with an operator, and is an important component of a network solution, typically a router, firewall, or route security all-in-one device.
vCPE (Virtual Customer Premises Equipment, virtual client device), also known as cloud CPE, is a method of providing virtual hosted services, such as routing, security, SD-WAN, etc., to a branch office or edge network through software rather than hardware. With vCPE, all hardware-based operations can now be implemented with software-based virtual functions. CPE runs on commodity hardware and Virtual Network Functions (VNFs), rather than proprietary ASICs that perform specific network functions, can be deployed in servers of hardware platforms, private clouds, and public cloud environments, and is a virtual network device for enterprise cloud applications.
And the elastic public network IP (Elastic IP Address, EIP) can independently purchase and hold public network IP address resources.
The Shared Bandwidth (BWS) can provide the capability of multiplexing the Bandwidth of multiple IP addresses at the region level, and can share the same Bandwidth for the ECS, load balancing, NAT gateway, etc. that bind EIP. Shared bandwidth is understood to be a pool of EIPs for encapsulation, all EIPs in the pool sharing the same bandwidth.
YML, a YAML (YAML Aint Markup Language) written file format, YAML is an intuitive data serialization format that can be recognized by a computer, and is easy for a human to read, easy to interact with a scripting language, and can be imported by different programming language programs supporting YAML libraries, such as: C/C++, ruby, python, java, perl, C#, PHP, etc. The YML file is based on data and is simpler than the traditional xml mode. The extension of YML file may use. YML or.yaml.
Prior to proceeding with the description of the embodiments of the present invention, description will be made of the prior art and the problems that exist therein:
when the bandwidth of a user needs to be dynamically increased in the existing SD-WAN network, the networking in the active-standby mode cannot flexibly meet the requirement, and the bandwidth of the original equipment can only be increased, which is troublesome. The construction of VCPE is currently mostly installed by adopting a manual method, an automatic process is not realized through file arrangement, the risk of middle mistakes is increased, and a large amount of manpower is consumed.
In one embodiment of the invention, the method is based on an SD-WAN network, which includes vcpe clusters therein; the vcpe cluster comprises a plurality of optional vcpe devices; the alternative vcpe devices are connected with each other.
Fig. 1 shows a flowchart of a data processing method provided by an embodiment of the present invention, which is performed by a computer processing device. The computer processing device may include a cell phone, a notebook computer, etc. As shown in fig. 1, the method comprises the steps of:
step 10: receiving a data processing request sent by a cpe device through a target vcpe device; the target vcpe device is one of the selectable vcpe devices.
In one embodiment of the invention, the cpe device may be a head-end device, such as a router, used by a user to connect the user to the internet.
One of the alternative vcpe devices may be randomly determined as the target vcpe device. And load balancing can be performed according to the load condition of each selectable vcpe device, and the selectable vcpe device with the minimum current load is determined as the target vcpe device.
In one embodiment of the present invention, considering that the construction of vcpe devices in the prior art is currently mostly installed by using a manual method, the efficiency and accuracy are low, and the requirement of fast networking to construct vcpe clusters cannot be met, so the method further includes, before step 10:
step 101: and acquiring the vcpe cluster arrangement file sent by the user.
In one embodiment of the present invention, the vcpe cluster layout file may be a yml file written by a user, which includes device parameter information for creating the optional vcpe device and network communication information between devices, where the device parameter information includes hardware information such as a CPU, a network card, a memory, and the like of the cloud host, and mirror image information of the optional vcpe device in the cloud. The network communication information may include information required for tunneling between the optional vcpe devices.
Step 102: and configuring the vcpe cluster and the connection between the cpe equipment and the vcpe cluster according to the vcpe cluster arrangement file.
In one embodiment of the present invention, the vcpe cluster layout file is parsed to obtain the aforementioned device parameter information and network communication information, thereby performing configuration.
Considering that the vcpe cluster arrangement file is written by a user, some form or technical errors may exist and cannot be converted into the vcpe cluster configuration file correctly, so in order to improve the efficiency of vcpe cluster construction and the usability of the constructed vcpe clusters, the vcpe cluster arrangement file can be checked based on some preset arrangement rules, and the file is automatically corrected according to the check result, so that the correct available vcpe cluster arrangement file is obtained. The arrangement rules are used to characterize the arrangement parameters and arrangement modes that must be satisfied by an available vcpe cluster, for example, whether resources of vcpe devices in the cluster are satisfied, whether tunnel configuration information is correct, whether an image file operates normally, whether there is an ip address error or conflict between the inner and outer clusters, and the like.
Thus, prior to step 102, further comprising: step 1021: and carrying out rule verification on the vcpe cluster arrangement file.
In one embodiment of the present invention, rule verification is performed according to a preset rule base, where a plurality of cluster configuration rules and corresponding disposition policies are stored in the preset rule base, where the cluster configuration rules are used to verify whether configuration information of a host is correct, verify whether an image file exists and operates normally, verify whether vcpe equipment resources in a cloud are satisfied, verify whether ips of wan and lan are correct and conflict, verify whether VPCs are the same, and verify whether tunnel configuration information is correct. The handling policy is used for modifying when the cluster configuration file does not meet the cluster configuration rule, reminding a user and the like to obtain the file meeting the rule to perform the corresponding available cluster.
Step 1022: and when the verification is passed, configuring the vcpe cluster and the connection between the cpe equipment and the vcpe cluster according to the vcpe cluster arrangement file.
In one embodiment of the invention, when the verification is passed, the vcpe cluster arrangement file is parsed to obtain device configuration information of each optional vcpe device in the vcpe cluster, device connection information in the cluster and connection information between the vcpe devices outside the cluster.
Step 1021 further comprises:
step 1023: and when the verification fails, determining a treatment strategy according to a preset rule base.
In one embodiment of the invention, a disposal strategy corresponding to file content which fails to pass the verification is searched according to a rule base.
Step 1024: and updating the vcpe cluster arrangement file according to the disposal strategy.
In one embodiment of the invention, the vcpe cluster arrangement file can be modified correspondingly automatically according to the treatment strategy to obtain an updated file. The user may also be prompted according to the disposition policy to enable the user to update the vcpe cluster orchestration file more quickly and accurately with the aid of the disposition policy.
In one embodiment of the present invention, step 1022 further comprises:
step 221: and analyzing the vcpe cluster arrangement file to obtain host information, external cluster network information and internal cluster network information corresponding to each piece of optional vcpe equipment.
In one embodiment of the present invention, the host information refers to device identification information and resources corresponding to vcpe devices, the intra-cluster network information includes network connection information, specifically may be tunnel connection information, between each optional vcpe device in a vcpe cluster corresponding to one virtual private cloud service, and the intra-cluster network information includes network connection information between each optional vcpe device in the vcpe cluster and a device outside the cloud, specifically may be connection with the vcpe device outside the cloud, so that a user may access the virtual private cloud service through the vcpe device.
Analyzing the vcpe cluster arrangement file according to the format of the vcpe cluster arrangement file, and extracting host information, external cluster network information and internal cluster network information respectively corresponding to the selectable vcpe equipment from the vcpe cluster arrangement file according to a plurality of preset fields, wherein the fields for representing the host information can comprise: identification information of optional vcpe equipment, resource configuration information and image file information. The identification information comprises an equipment ID and an equipment name, the resource configuration information comprises a CPU and a memory, the image file information comprises images required by the vcpe equipment in the virtual private cloud, and one virtual private cloud corresponds to one vcpe cluster.
The fields characterizing network information within the cluster may include: the method comprises the steps of cluster identification information, cluster description information, wan side network information, lan side network information, domain information, subnet information, host information and virtual private cloud information, wherein the wan side network information, the lan side network information, the domain information, the host information and the virtual private cloud information respectively correspond to two ends of a tunnel between the current vcpe device and any other vcpe device in a cluster.
The fields characterizing the network information outside the cluster may include: the public network ip address used between the vcpe device and the cpe device may specifically correspond to an elastic public network ip.
Step 222: and establishing the selectable vcpe equipment and a first tunnel between every two selectable vcpe equipment according to the intra-cluster network information.
In one embodiment of the invention, the first tunnel may be a VxLAN tunnel established on the wan side of each vcpe. By establishing a plurality of selectable Vcpe devices in the Vcpe cluster, establishing a VxLAN tunnel between every two of wan sides of each Vcpe, and combining the Vcpe devices into a full mesh (full interconnection) network in the cluster, when a single selectable Vcpe device fails, the data processing request can be conveniently forwarded to other available selectable Vcpe devices through the full interconnection network for processing, the rapid processing of the failure and the unaware of the failure by a user are realized, and the virtual private cloud service using experience of the user is improved.
Step 223: and establishing a second tunnel between the cpe device and each vcpe device according to the host information and the out-of-cluster network information.
In one embodiment of the present invention, the second tunnel is established based on an elastic public network ip; and sharing bandwidth among the second tunnels. The second tunnels are established through the elastic public network ip, and the traffic sent by the user through the cpe device is distributed among the plurality of second tunnels through the shared bandwidth, so that the user does not need to pay for the plurality of second tunnels at the same time, and only needs to bear the cost of the shared bandwidth.
In addition, unlike the prior art that when the user bandwidth needs to be dynamically changed in the SDWAN network, the networking in the active-standby mode cannot meet the requirement of flexibly updating the bandwidth, and the efficiency is low and the usability is low only by increasing the bandwidth of the original equipment.
Optionally, the cpe device may further set a metric (hop count) value as required, and send the data processing request to the vcpe device corresponding to the second tunnel with the smallest arrival hop count, so as to implement load balancing of the vcpe device in the cluster on data processing outside the cloud.
Step 20: when the target vcpe device is unavailable, an available vcpe device is determined from a plurality of selectable vcpe devices connected to the target vcpe device.
In one embodiment of the invention, the available vcpe devices may be available vcpe devices of any of the aforementioned fully connected networks within the cluster.
Step 30: and forwarding the data processing request to a target virtual machine through the available vcpe equipment, wherein the target virtual machine is used for processing the data processing request.
In one embodiment of the invention, the fast forwarding of the data processing request in the fault is realized through the first tunnel, so that the fault can respond to the cloud service request without perception, and the high availability of the virtual private cloud service is realized.
In one embodiment of the present invention, the SD-WAN network further includes a virtual routing device; each selectable vcpe device is connected with the virtual routing device respectively; the virtual routing equipment is configured with routing information between each selectable vcpe equipment and a plurality of selectable virtual machines; the target virtual machine is one of the selectable virtual machines.
The virtual routing device may be a vruter, and the virtual routing device is connected between the LAN side of the vcpe cluster and the optional virtual machine, where data of the optional virtual machine may be set according to a scale and a requirement of the cluster, and routing information configured in the virtual routing device is used to implement data transmission between the optional vcpe device and the optional virtual machine.
In still another embodiment of the present invention, the data processing process may also refer to fig. 2, as shown in fig. 2, first, a user writes yml files according to the number required by the vcpe cluster, and completes a host part and a tunnel part, where the host part includes cloud host basic information, network information and the like required by each optional vcpe, the tunnel part includes information for establishing a tunnel between optional vcpe devices, such as id information of two vcpes at two ends of the tunnel, information of wan side subnets is found according to ids, and then a tunnel is established through VxLAN.
Specifically, vcpe cluster orchestration files may be as follows:
metadata: # content such as the name of the orchestrated file
name test#vcpe Cluster name
description: # description
Information of hosts: #vcpe cluster
host: # basic information needed for establishing single vcpe
id of host1 # vcpe
name virtual machine name #vcpe name
cpu: cpu of 5 # vcpe
memory of mem:20 # vcpe
wan network on wan side of 192.168.5.4 # vcpe
lan-side network of 192.168.22.2 # vcpe
Public network ip between eip 10.10.6.3 # cpe and vcpe
iamge vcpe_host 1# establishes the image within the cloud required for vcpe
region AZ1# establishes the domain of vcpe
subnet 192.5.6.4 # subnet information to build vcpe
vpc:t1# establishes vpc information of vpe
host:
id:host2
name of virtual machine
cpu：5
mem:20
wan:192.168.5.6
lan:192.168.22.6
eip:10.10.6.5
iamge:vcpe_host2
region:AZ1
subnet:192.5.6.5
vpc:t1
tunnel: # tunnel setup information between all vcpes
tunnel: #vcpe tunnel setup information
src host1 # source vcpe host information
Host information of host # 2 destination vcpe
tunnel:
src:host2
dst:host3
Optionally, a cluster arrangement template and/or a cluster arrangement interface may be provided, which is used to prompt the user to write the vcpe cluster arrangement file, so as to provide efficiency and accuracy of vcpe cluster creation.
After receiving yml files written by the user, the arrangement module formats the arrangement files of the user according to file formats specified by the cloud and the controller.
After the verification module receives the content of the arranged file, the rule library is required to be queried for the rule to be verified, the file is verified according to the rule content, if the verification of the content fails, the action of solving the problem in the rule library is searched according to the failed content, the error solving content is closed-loop, if the error solving content cannot be automatically solved, the reason of the failure is returned.
And the split file information is sent to an in-cloud engine, and interaction is carried out with the service in the cloud according to the content of the file.
And sending the file information to a controller engine, and taking charge of establishment of tunnels and the like.
In yet another embodiment of the present invention, based on the network structure shown in the figure, the vcpe cluster environment on which the data processing is based may refer to fig. 3.
As shown in fig. 2, tunnels are established between the cpe and vcpe used by the user side through an elastic public network ip, multiple tunnels need to distribute user traffic through sharing bandwidth, users do not need to consume the cost of multiple tunnels at the same time, only need to share the same bandwidth cost, and meanwhile, the cpe device needs to set a meta value, so that load balancing can be ensured.
And (3) establishing a plurality of vcpe devices in the cloud, wherein every two of wan sides of each vcpe are required to establish a VxLAN tunnel, combining the vcpe devices into a full mesh (fully interconnected) network, configuring routes to subnets in the cloud on the vcpe, and configuring a backhaul route from the next hop to the vcpe on the vcrouter.
Based on the network environment shown in fig. 3, the data flow when the normal client side accesses vm3 is as shown in fig. 4, and the flow path diagram when the access request is received is as follows: the route of the backhaul is vm3- > vcpe1- > cpe.
Assuming that the tunnel between cpe to vcpe1 in fig. 4 fails, the tunnel within the access cloud will switch to a good link, as shown in fig. 5, and the traffic path at the time of access request reception becomes: cpe- > vcpe2- > vcpe1- > vruter- > vm3.
The path of the backhaul becomes: vm3- > vruter- > vcpe1- > vcpe2- > cpe.
The data processing method provided by the embodiment of the invention is based on an SD-WAN network; the SD-WAN network comprises a vcpe cluster; the vcpe cluster comprises a plurality of optional vcpe devices; the optional vcpe devices are connected with each other; according to the embodiment of the invention, the target vcpe equipment receives the data processing request sent by the cpe equipment; the target vcpe device is one of the selectable vcpe devices; determining an available vcpe device from a plurality of selectable vcpe devices connected to the target vcpe device when the target vcpe device is unavailable; and forwarding the data processing request to a target virtual machine through the available vcpe equipment, wherein the target virtual machine is used for processing the data processing request. According to the data processing method provided by the embodiment of the invention, the data processing request is forwarded and processed through the vcpe cluster which is fully interconnected in the virtual private cloud service, so that the availability of the SD-WAN network can be improved.
Fig. 6 is a schematic structural diagram of a data processing apparatus according to an embodiment of the present invention. As shown in fig. 6, the apparatus 40 includes: a receiving module 401, a determining module 402 and a forwarding module 403.
The receiving module 401 is configured to receive, by using a target vcpe device, a data processing request sent by the vcpe device; the target vcpe device is one of the selectable vcpe devices;
a determining module 402, configured to determine, when the target vcpe device is not available, an available vcpe device from a plurality of selectable vcpe devices connected to the target vcpe device;
and the forwarding module 403 is configured to forward, through the available vcpe device, the data processing request to a target virtual machine, where the target virtual machine is configured to process the data processing request.
The operation process of the data processing device provided in the embodiment of the present invention is substantially the same as that of the foregoing method embodiment, and will not be repeated.
The data processing device provided by the embodiment of the invention is based on an SD-WAN network; the SD-WAN network comprises a vcpe cluster; the vcpe cluster comprises a plurality of optional vcpe devices; the optional vcpe devices are connected with each other; according to the embodiment of the invention, the target vcpe equipment receives the data processing request sent by the cpe equipment; the target vcpe device is one of the selectable vcpe devices; determining an available vcpe device from a plurality of selectable vcpe devices connected to the target vcpe device when the target vcpe device is unavailable; and forwarding the data processing request to a target virtual machine through the available vcpe equipment, wherein the target virtual machine is used for processing the data processing request. The data processing device provided by the embodiment of the invention forwards and processes the data processing request through the vcpe cluster which is fully interconnected in the virtual private cloud service, so that the availability of the SD-WAN network can be improved.
Fig. 7 is a schematic structural diagram of a data processing device according to an embodiment of the present invention, and the specific embodiment of the present invention is not limited to a specific implementation of the data processing device.
As shown in fig. 7, the data processing apparatus may include: a processor 402, a communication interface (Communications Interface) 404, a memory 506, and a communication bus 508.
Wherein: processor 502, communication interface 504, and memory 506 communicate with each other via communication bus 508. A communication interface 504 for communicating with network elements of other devices, such as clients or other servers. The processor 502 is configured to execute the program 510, and may specifically perform the relevant steps in the embodiments of the data processing method described above.
In particular, program 510 may include program code comprising computer-executable instructions.
The processor 502 may be a central processing unit CPU, or a specific integrated circuit ASIC (Application Specific Integrated Circuit), or one or more integrated circuits configured to implement embodiments of the present invention. The one or more processors comprised by the data processing device may be the same type of processor, such as one or more CPUs; but may also be different types of processors such as one or more CPUs and one or more ASICs.
A memory 506 for storing a program 510. Memory 506 may comprise high-speed RAM memory or may also include non-volatile memory (non-volatile memory), such as at least one disk memory.
The program 510 may be specifically invoked by the processor 502 to cause the data processing apparatus to:
receiving a data processing request sent by a cpe device through a target vcpe device; the target vcpe device is one of the selectable vcpe devices;
determining an available vcpe device from a plurality of selectable vcpe devices connected to the target vcpe device when the target vcpe device is unavailable;
and forwarding the data processing request to a target virtual machine through the available vcpe equipment, wherein the target virtual machine is used for processing the data processing request.
The operation process of the data processing device provided in the embodiment of the present invention is substantially the same as that of the foregoing method embodiment, and will not be described again.
The data processing equipment provided by the embodiment of the invention is based on an SD-WAN network; the SD-WAN network comprises a vcpe cluster; the vcpe cluster comprises a plurality of optional vcpe devices; the optional vcpe devices are connected with each other; according to the embodiment of the invention, the target vcpe equipment receives the data processing request sent by the cpe equipment; the target vcpe device is one of the selectable vcpe devices; determining an available vcpe device from a plurality of selectable vcpe devices connected to the target vcpe device when the target vcpe device is unavailable; and forwarding the data processing request to a target virtual machine through the available vcpe equipment, wherein the target virtual machine is used for processing the data processing request. The data processing equipment provided by the embodiment of the invention forwards and processes the data processing request through the vcpe cluster which is fully interconnected in the virtual private cloud service, so that the availability of the SD-WAN network can be improved.
An embodiment of the present invention provides a computer readable storage medium storing at least one executable instruction that, when executed on a data processing apparatus, causes the data processing apparatus to perform a data processing method according to any of the above-described method embodiments.
The executable instructions may be specifically operable to cause a data processing apparatus to:
receiving a data processing request sent by a cpe device through a target vcpe device; the target vcpe device is one of the selectable vcpe devices;
determining an available vcpe device from a plurality of selectable vcpe devices connected to the target vcpe device when the target vcpe device is unavailable;
and forwarding the data processing request to a target virtual machine through the available vcpe equipment, wherein the target virtual machine is used for processing the data processing request.
The operation process of the executable instructions stored in the computer storage medium provided in the embodiment of the present invention is substantially the same as that of the foregoing method embodiment, and will not be repeated.
The executable instructions stored in the computer storage medium provided by the embodiment of the invention are based on an SD-WAN network; the SD-WAN network comprises a vcpe cluster; the vcpe cluster comprises a plurality of optional vcpe devices; the optional vcpe devices are connected with each other; according to the embodiment of the invention, the target vcpe equipment receives the data processing request sent by the cpe equipment; the target vcpe device is one of the selectable vcpe devices; determining an available vcpe device from a plurality of selectable vcpe devices connected to the target vcpe device when the target vcpe device is unavailable; and forwarding the data processing request to a target virtual machine through the available vcpe equipment, wherein the target virtual machine is used for processing the data processing request. According to the embodiment of the invention, the data processing request is forwarded and processed through the vcpe cluster which is fully interconnected in the virtual private cloud service, so that the availability of the SD-WAN network can be improved.
The embodiment of the invention provides a data processing device for executing the data processing method.
An embodiment of the present invention provides a computer program that is callable by a processor to cause a data processing apparatus to perform the data processing method of any of the method embodiments described above.
Embodiments of the present invention provide a computer program product comprising a computer program stored on a computer readable storage medium, the computer program comprising program instructions which, when run on a computer, cause the computer to perform the data processing method of any of the method embodiments described above.
The algorithms or displays presented herein are not inherently related to any particular computer, virtual system, or other apparatus. Various general-purpose systems may also be used with the teachings herein. The required structure for a construction of such a system is apparent from the description above. In addition, embodiments of the present invention are not directed to any particular programming language. It will be appreciated that the teachings of the present invention described herein may be implemented in a variety of programming languages, and the above description of specific languages is provided for disclosure of enablement and best mode of the present invention.
In the description provided herein, numerous specific details are set forth. However, it is understood that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.
Similarly, it should be appreciated that in the above description of exemplary embodiments of the invention, various features of the embodiments of the invention are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure and aiding in the understanding of one or more of the various inventive aspects. However, the disclosed method should not be construed as reflecting the intention that: i.e., the claimed invention requires more features than are expressly recited in each claim.
Those skilled in the art will appreciate that the modules in the apparatus of the embodiments may be adaptively changed and disposed in one or more apparatuses different from the embodiments. The modules or units or components of the embodiments may be combined into one module or unit or component, and they may be divided into a plurality of sub-modules or sub-units or sub-components. Any combination of all features disclosed in this specification (including any accompanying claims, abstract and drawings), and all of the processes or units of any method or apparatus so disclosed, may be used in combination, except insofar as at least some of such features and/or processes or units are mutually exclusive. Each feature disclosed in this specification (including any accompanying claims, abstract and drawings), may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.
It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The use of the words first, second, third, etc. do not denote any order. These words may be interpreted as names. The steps in the above embodiments should not be construed as limiting the order of execution unless specifically stated.

Claims (10)

1. A data processing method, characterized in that the method is based on an SD-WAN network; the SD-WAN network comprises a vcpe cluster; the vcpe cluster comprises a plurality of optional vcpe devices; the optional vcpe devices are connected with each other; the method comprises the following steps:
receiving a data processing request sent by a cpe device through a target vcpe device; the target vcpe device is one of the selectable vcpe devices;
determining an available vcpe device from a plurality of selectable vcpe devices connected to the target vcpe device when the target vcpe device is unavailable;
and forwarding the data processing request to a target virtual machine through the available vcpe equipment, wherein the target virtual machine is used for processing the data processing request.
2. The method of claim 1, further comprising a virtual routing device in the SD-WAN network; each selectable vcpe device is connected with the virtual routing device respectively; the virtual routing equipment is configured with routing information between each selectable vcpe equipment and a plurality of selectable virtual machines; the target virtual machine is one of the selectable virtual machines.
3. The method of claim 1, comprising, prior to receiving, by a target vcpe device in the vcpe cluster, a data processing request sent by a cpe device:
acquiring a vcpe cluster arrangement file sent by a user;
and configuring the vcpe cluster and the connection between the cpe equipment and the vcpe cluster according to the vcpe cluster arrangement file.
4. The method of claim 3, comprising, prior to said configuring said vcpe clusters and connections between said cpe devices and said vcpe clusters according to said vcpe cluster orchestration file:
performing rule verification on the vcpe cluster arrangement file;
and when the verification is passed, configuring the vcpe cluster and the connection between the cpe equipment and the vcpe cluster according to the vcpe cluster arrangement file.
5. The method of claim 4, further comprising, after said rule checking said vcpe cluster orchestration file:
when the verification fails, determining a treatment strategy according to a preset rule base;
and updating the vcpe cluster arrangement file according to the disposal strategy.
6. The method of claim 3, wherein configuring the vcpe clusters and connections between the cpe devices and the vcpe clusters according to the vcpe cluster orchestration file comprises:
analyzing the vcpe cluster arrangement file to obtain host information, external cluster network information and internal cluster network information corresponding to each piece of selectable vcpe equipment respectively;
establishing the selectable vcpe devices and a first tunnel between every two selectable vcpe devices according to the intra-cluster network information;
and establishing a second tunnel between the cpe device and each vcpe device according to the host information and the out-of-cluster network information.
7. The method of claim 6, wherein the second tunnel is established based on an elastic public network ip; and sharing bandwidth among the second tunnels.
8. A data processing apparatus, the apparatus comprising:
the receiving module is used for receiving a data processing request sent by the cpe device through the target vcpe device; the target vcpe device is one of the selectable vcpe devices;
a determining module, configured to determine, when the target vcpe device is unavailable, an available vcpe device from a plurality of selectable vcpe devices connected to the target vcpe device;
and the forwarding module is used for forwarding the data processing request to a target virtual machine through the available vcpe equipment, and the target virtual machine is used for processing the data processing request.
9. A data processing apparatus, comprising: the device comprises a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface complete communication with each other through the communication bus;
the memory is configured to store at least one executable instruction that causes the processor to perform the operations of the data processing method according to any one of claims 1 to 7.
10. A computer readable storage medium, characterized in that at least one executable instruction is stored in the storage medium, which executable instruction, when run on a data processing device, causes the data processing device to perform the operations of the data processing method according to any of claims 1-7.
CN202210866290.2A 2022-07-22 2022-07-22 Data processing method, device, equipment and computer storage medium Pending CN116264538A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210866290.2A CN116264538A (en) 2022-07-22 2022-07-22 Data processing method, device, equipment and computer storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210866290.2A CN116264538A (en) 2022-07-22 2022-07-22 Data processing method, device, equipment and computer storage medium

Publications (1)

Publication Number Publication Date
CN116264538A true CN116264538A (en) 2023-06-16

Family

ID=86722856

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210866290.2A Pending CN116264538A (en) 2022-07-22 2022-07-22 Data processing method, device, equipment and computer storage medium

Country Status (1)

Country Link
CN (1) CN116264538A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116915585A (en) * 2023-09-13 2023-10-20 中移(苏州)软件技术有限公司 Software-defined wide area network networking method, device, electronic equipment and storage medium

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116915585A (en) * 2023-09-13 2023-10-20 中移(苏州)软件技术有限公司 Software-defined wide area network networking method, device, electronic equipment and storage medium
CN116915585B (en) * 2023-09-13 2023-12-01 中移(苏州)软件技术有限公司 Software-defined wide area network networking method, device, electronic equipment and storage medium

Similar Documents

Publication Publication Date Title
US20210409336A1 (en) Validating network flows in a multi-tenanted network appliance routing service
CN112165532B (en) Node access method, device, equipment and computer readable storage medium
US7257817B2 (en) Virtual network with adaptive dispatcher
US7899047B2 (en) Virtual network with adaptive dispatcher
US11102278B2 (en) Method for managing a software-defined data center implementing redundant cloud management stacks with duplicate API calls processed in parallel
US11184277B1 (en) Reducing routing rules used to route traffic
US9438670B2 (en) Data replication for a virtual networking system
US9935834B1 (en) Automated configuration of virtual port channels
CN113315706B (en) Private cloud flow control method, device and system
CN113810230A (en) Method, device and system for carrying out network configuration on containers in container cluster
US20230045247A1 (en) Transmitting network traffic to a pool of redundant network appliances
US20220012091A1 (en) System and method for executing multi-stage distributed computing operations with independent rollback workflow
US20240121301A1 (en) Secure communications of storage tenants that share a storage cluster system
CN116264538A (en) Data processing method, device, equipment and computer storage medium
CN110380930B (en) Test method, test device, server and computer storage medium
CN114363346A (en) IP mounting and data processing method and device
US20220141080A1 (en) Availability-enhancing gateways for network traffic in virtualized computing environments
CN115941456A (en) Network Policy Generation for Continuous Deployment
CN115516842A (en) Orchestration broker service
US11671353B2 (en) Distributed health monitoring and rerouting in a computer network
US20240129185A1 (en) Secure bi-directional network connectivity system between private networks
US20240095809A1 (en) Cloud infrastructure-based online publishing platforms for virtual private label clouds
US20230101973A1 (en) Protecting instances of resources of a container orchestration platform from unintentional deletion
CN117014443A (en) Cloud load balancing method, device, equipment, storage medium and system
CN115686818A (en) Configuration method and device of elastic network interface ENI

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination