CN113783910A - Data forwarding method, device and system - Google Patents

Data forwarding method, device and system Download PDF

Info

Publication number
CN113783910A
CN113783910A CN202010526434.0A CN202010526434A CN113783910A CN 113783910 A CN113783910 A CN 113783910A CN 202010526434 A CN202010526434 A CN 202010526434A CN 113783910 A CN113783910 A CN 113783910A
Authority
CN
China
Prior art keywords
interface
data message
uplink data
quintuple information
network card
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010526434.0A
Other languages
Chinese (zh)
Other versions
CN113783910B (en
Inventor
余年兵
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alibaba Group Holding Ltd
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Priority to CN202010526434.0A priority Critical patent/CN113783910B/en
Publication of CN113783910A publication Critical patent/CN113783910A/en
Application granted granted Critical
Publication of CN113783910B publication Critical patent/CN113783910B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L49/00Packet switching elements
    • H04L49/70Virtual switches

Abstract

The disclosure relates to a method, a device and a system for data forwarding. The method comprises the following steps: receiving an uplink data message sent by a virtual machine, and determining an interface on the network card, which needs to process the uplink data message; and sending the uplink data message to a virtual switch connected with the interface through the interface for forwarding according to the determined interface. According to the method, the virtual switch is integrated in the set-top switch, each server does not need to bear the function of the virtual switch, on one hand, the hardware cost of the server is reduced, and in addition, the forwarding multiplexing ratio of the virtual switch is also improved, so that the system resources of the server can be more effectively utilized, and the power consumption of the server is reduced.

Description

Data forwarding method, device and system
Technical Field
The present disclosure relates to the field of cloud technologies, and in particular, to a method, an apparatus, and a system for data forwarding.
Background
The cloud technology is a technology for unifying series resources such as hardware, software, networks and the like in a wide area network or a local area network to realize data calculation, storage, processing and sharing, and has the basic characteristics of Virtualization (Virtualization) and distribution, wherein the Virtualization technology abstracts and converts computer resources such as servers, networks, memories, storage and the like and then presents the computer resources, for example, a virtual machine implementation mode is used, so that a user can better apply the resources without the limitation of conditions such as physical forms, regions and the like of the existing resources. The distributed network storage technology dispersedly stores data on a plurality of independent machine devices, thereby not only solving the bottleneck problem of a single storage server in the traditional centralized storage system, but also improving the reliability, the availability and the expansibility of the system.
At present, various clouds realized by using a cloud technology are often built by a large number of servers.
A common network deployment method for accessing a server to a network is shown in fig. 1, where servers in a same Rack are all connected to a Top switch (ToR) of an entity located at the Top of a cabinet, and the Top switches of different cabinets are further connected to a convergence switch. Therefore, a plurality of virtual machines on the server can be connected with the set-top switch through the virtual switch (vSwtich) belonging to the same server, so that network access and data forwarding are realized.
The physical carrier of the existing virtual switch is usually a CPU or a physical network card of a server, and each server is provided with a virtual switch, which has the advantage of reducing the fault domain by a distributed manner, but because the virtual switch usually needs a higher configured network card, such as a network card configured with a Programmable logic device (FPGA), or is implemented by using a CPU, the disadvantage is that the hardware cost of the server is higher, or the problem of occupying the system resource of the server and having higher power consumption is caused.
Disclosure of Invention
In view of the above, the present disclosure is proposed to provide a method, apparatus and system for data forwarding that overcomes or at least partially solves the above mentioned problems.
In a first aspect, an embodiment of the present disclosure provides a method for forwarding data, including:
receiving an uplink data message sent by a virtual machine, and determining an interface which needs to process the uplink data message;
and sending the uplink data message to a virtual switch connected with the interface through the interface for forwarding according to the determined interface.
In one embodiment, determining the interface to process the data packet includes:
determining IP quintuple information in the uplink data message;
and searching a sending interface corresponding to the determined IP quintuple information from a mapping relation between the pre-stored IP quintuple information and a sending interface identifier according to the determined IP quintuple information.
In an embodiment, before searching for a sending interface corresponding to the determined IP quintuple information from a mapping relationship between pre-stored IP quintuple information and a sending interface identifier, the method further includes:
determining that the state corresponding to the IP quintuple information is an initial state or a non-initial state, wherein the initial state represents that an uplink data message containing the IP quintuple information is not sent, and the non-initial state represents that an uplink data message containing the IP quintuple information is sent;
if the data message is determined to be in the initial state, selecting a sending interface from the interfaces of the network card, and creating a mapping relation between IP five-tuple information of the data message and a sending interface identifier;
if the IP quintuple information is determined to be in the non-initial state, the step of searching the sending interface corresponding to the determined IP quintuple information from the mapping relation of the pre-stored IP quintuple information and the sending interface identifier is carried out.
In one embodiment, if the initial state is determined, selecting a sending interface from the interfaces of the network card includes:
based on IP quintuple information of the data message to be sent, carrying out hash operation;
and selecting a sending interface from the interfaces of the network card according to the hash operation result.
In one embodiment, the method further comprises:
when receiving downlink data forwarded by a connected virtual switch, determining whether the downlink data message and the uplink data message belong to the same session according to IP five-tuple information of the downlink data message;
and if so, replacing the transmitting interface identifier in the mapping relation between the IP quintuple information of the uplink data message and the transmitting interface identifier by using the receiving interface identifier of the downlink data message.
In one embodiment, the method further comprises:
if the interface needing to forward the uplink data message is determined to be in fault, the uplink data message is sent to the virtual switch on the other top switch connected with the interface without fault for forwarding by selecting the interface without fault in the network card;
and when a downlink data message of the same session of the uplink data message is received from the interface without the fault, replacing the sending interface identifier in the mapping relation between the IP quintuple information of the uplink data message and the sending interface identifier by using the identifier of the interface without the fault.
In one embodiment, the method further comprises:
if the failed interface is recovered and the downlink data message received from the recovered interface is determined, extracting IP five-tuple information in the downlink data message and recording the identifier of the recovered interface;
and determining IP quintuple information corresponding to an uplink data message which belongs to the same session with the downlink data message according to the extracted IP quintuple information, and replacing a sending interface identifier in the mapping relation between the IP quintuple information of the uplink data message and the sending interface identifier by using the identifier of the recovered interface.
In one embodiment, the data forwarding method is executed by a network card, and the network card forwards an uplink data packet to a virtual switch on the set-top switch in a bypass manner, or receives a downlink data packet from the virtual switch on the set-top switch.
In a second aspect, an embodiment of the present disclosure provides a method for forwarding data, including:
the virtual switch receives an uplink data message forwarded by a network card of the server;
and after the virtual switch processes the uplink data message by the data link layer, forwarding the uplink data message by the set-top switch where the virtual switch is located.
In a third aspect, an embodiment of the present disclosure provides an apparatus for data forwarding, including:
the interface determining module is used for receiving an uplink data message sent by the virtual machine and determining an interface which needs to process the uplink data message;
and the forwarding module is used for sending the uplink data message to a virtual switch connected with the interface through the interface for forwarding according to the determined interface.
In a fourth aspect, an embodiment of the present disclosure provides a network card, including: memory, processor and computer instructions stored on the memory and executable on the processor, wherein the instructions when executed by the processor are capable of implementing the above-described data forwarding method.
In a fifth aspect, an embodiment of the present disclosure provides a system for data forwarding, including: at least one server, a virtual switch and a set-top switch; the virtual switch is arranged in the top switch;
the server is provided with at least one virtual machine, and a network card of the server is connected with the virtual switch; the server is used for determining an interface on the network card, which needs to process the uplink data message, when the network card receives the uplink data message sent by the connected virtual machine; according to the determined interface, the uplink data message is sent to a virtual switch connected with the interface through the interface;
and the virtual switch is used for forwarding the uplink data messages through the top switch after the uplink data messages are processed by the data link layer.
In one embodiment, the system comprises at least two of the set-top switches and at least two of the virtual switches; the more than two virtual switches are respectively arranged in the more than two top switches;
the network card on the server is provided with at least two interfaces, and the interfaces are respectively connected with different virtual switches and the set-top switch.
In a sixth aspect, an embodiment of the present disclosure provides a switch, including: memory, processor and computer instructions stored on the memory and executable on the processor, wherein the instructions when executed by the processor are capable of implementing the aforementioned method of data forwarding.
In a seventh aspect, the disclosed embodiments provide a computer-readable storage medium, on which computer instructions are stored, and when executed by a processor, the computer instructions can implement the foregoing data forwarding method.
The beneficial effects of the above technical scheme provided by the embodiment of the present disclosure at least include:
according to the method, the device and the system for forwarding the data, the virtual switch is arranged in the set-top switch, when the network card of the server receives the uplink data message sent by the virtual machine, an interface which needs to process the uplink data message on the network card is determined, and according to the determined interface, the uplink data message is sent to the virtual switch which is connected with the interface and is positioned on the set-top switch through the interface to be forwarded. Compared with the prior art, the virtual switch is moved forward to the set-top switch from the server side, so that a plurality of servers (for example, located on the same rack) can be connected with one virtual switch, the same virtual switch is enabled to multiplex and forward data messages of virtual machines on the plurality of servers, the forwarding multiplexing ratio of the virtual switch is improved through the centralized virtual switch, on one hand, the hardware cost of the servers can be reduced, on the other hand, the virtual switch is arranged in the set-top switch in front, the virtual switch does not need to be arranged in each server, the virtual switch can be shared by the plurality of servers, and each server does not need to be used for the function of the virtual switch, so that the system resources can be more effectively utilized, and the power consumption of the servers is reduced.
In one embodiment, a plurality of interfaces may be provided on a server, and different interfaces are connected to different virtual switches.
Additional features and advantages of the disclosure will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by the practice of the disclosure. The objectives and other advantages of the disclosure may be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
The technical solution of the present disclosure is further described in detail by the accompanying drawings and examples.
Drawings
The accompanying drawings are included to provide a further understanding of the disclosure and are incorporated in and constitute a part of this specification, illustrate embodiments of the disclosure and together with the description serve to explain the principles of the disclosure and not to limit the disclosure. In the drawings:
FIG. 1 is a schematic diagram of a network architecture of a network deployment mode of a server access network;
fig. 2 is a schematic network architecture diagram illustrating a network deployment manner in which a server accesses a network according to an embodiment of the present disclosure;
FIG. 3 is a schematic diagram illustrating a network card forwarding in a bypass manner according to an embodiment of the present disclosure;
FIG. 4 is a flow chart of a method of data forwarding in an embodiment of the present disclosure;
FIG. 5 is a flowchart of a process for searching for IP five tuple information state related information in an embodiment of the present disclosure;
FIG. 6 is a flowchart of a method for data forwarding in an embodiment of the present disclosure;
fig. 7 is a network architecture diagram of a first and second embodiment of the present disclosure;
fig. 8 is a block diagram of a data forwarding apparatus according to an embodiment of the present disclosure.
Detailed Description
Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
In order to solve the problems of high hardware cost, occupation of server system resources and high power consumption of a server caused by a network access mode of the server in the prior art, the embodiment of the disclosure improves the access mode of the existing server, thereby improving a data forwarding mode of the server.
Before describing the data forwarding method provided by the embodiment of the present disclosure, a network architecture of an access manner of a server corresponding to the embodiment of the present disclosure is briefly described.
Referring to fig. 2, in the embodiment of the present disclosure, a virtual switch is moved up to a set-top switch, more than one server is connected to the same virtual switch through its own network card, and meanwhile, the server may have one or more virtual machines, so that each virtual machine may be connected to the virtual switch through the network card of the server.
In the context of one or some embodiments, multiple set-top switches are connected to the same aggregation switch at an upper level of the set-top switches.
It should be noted that, in the technical solution provided in the embodiment of the present invention, the server may be various types of servers, including but not limited to various cloud servers structured as a cloud, an application server implementing some specific applications, a data server, and the like, and the embodiment of the present invention is not limited specifically.
Alternatively, as shown in fig. 2, because a plurality of servers share one virtual switch, based on disaster tolerance considerations, a plurality of virtual switches may be required to be mutually prepared, and similarly, a plurality of set-top switches (a set-top switch may integrate at least one virtual switch) are also required, so that different interfaces of the network card on each server may be connected to different virtual switches.
In one embodiment, to better guarantee the performance of the virtual switch, in the set-top switch, the virtual switch may be implemented using a separate chip, the processing of the data link layer of the virtual switch, and the like, may be implemented using software embedded in the chip. The virtual switch is realized by using a single chip, and the performance of the virtual switch can be ensured on the aspect of hardware forwarding efficiency so as to meet the requirement of serving a plurality of servers.
Correspondingly, the server no longer takes charge of the function of the virtual switch, specifically, the network card on the server no longer realizes the function of the virtual switch, so compared with the prior art, the network card can adopt the network card with simpler function and lower cost, and can realize the forwarding of the physical layer without processing the OSI two layer, namely the data link layer.
One possible implementation manner is shown in fig. 3, the network card uses a bypass (bypass) manner to implement data forwarding.
By means of bypass, network card and connected virtual switch can be connected directly physically, network card can not process data link layer for packet in network, and process data link layer when forwarding by virtual switch.
Based on the above networking manner, the data packet of the virtual machine on the server is forwarded to the virtual switch through the network card of the server, and then the virtual switch forwards the data packet to the aggregation switch through the top switch, so as to perform subsequent further forwarding processing.
Based on the network deployment mode, the method for forwarding data provided by the embodiment of the present disclosure, for the network card of the server, as shown in fig. 4, executes the following steps:
s41, receiving an uplink data message sent by the virtual machine, and determining an interface needing to process the uplink data message;
and S42, according to the determined interface, sending the uplink data message to the virtual switch connected with the interface through the interface for forwarding.
The above-described flow may be implemented by, for example, a network card on a server.
The virtual switch is arranged in the set-top switch, and when the network card of the server receives the uplink data message sent by the virtual machine, the interface of the network card, which needs to process the uplink data message, is determined first, and then the uplink data message is sent to the virtual switch connected with the interface and positioned on the set-top switch through the interface to be forwarded according to the determined interface. Compared with the prior art, the virtual switch is moved forward to the set-top switch from the server side, so that a plurality of servers (for example, located on the same rack) can be connected with one virtual switch, the same virtual switch is enabled to multiplex and forward data messages of virtual machines on the plurality of servers, the forwarding multiplexing ratio of the virtual switch is improved through the centralized virtual switch, on one hand, the hardware cost of the servers can be reduced, on the other hand, the virtual switch is arranged in the set-top switch in front, the virtual switch does not need to be arranged in each server, the virtual switch can be shared by the plurality of servers, and each server does not need to be used for the function of the virtual switch, so that the system resources can be more effectively utilized, and the power consumption of the servers is reduced.
Because multiple servers in the same enclosure share one virtual switch for communication, for disaster tolerance, in one or more possible embodiments, as also shown in fig. 2, two or more virtual switches may be provided in the same enclosure, and accordingly, the set-top switch may also be provided in multiple numbers because the virtual switch is provided in the set-top switch. The virtual switches are backup with each other, and share the communication work of a plurality of servers in the same cabinet according to a preset strategy, such as a load balancing strategy.
For stateful services, it is necessary to keep the incoming and outgoing paths of data packets in different directions, i.e. uplink and downlink, of the same Session (Session) consistent.
Stateful services are in contrast to stateless services, which refers to any state in which a service providing a service does not retain interaction with a client. That is, the last request has no influence on the current request, and the server does not perform any recording process on the last request of the client. Otherwise, the service with the state needs to record the state of the last interaction with the client, so as to process the subsequent request and response of the client again.
For example, a stateful service is described, for example, a user logs in a certain service platform by using a user name and a password, and a data message generated in a subsequent service processing process needs to be operated for the logged-in user, and it is not necessary to perform a login operation in advance before each request.
For stateful services, the same Session will be used, which means both the meaning of "connection oriented" or "hold state". In a scenario that a client accesses a server through a browser, when the client browser accesses the server, the server records client information in some form on a server, which is Session (i.e., stateful). When the client browser accesses again, the client state only needs to be searched from the Session.
If two or more virtual switches are connected to a server in the same cabinet at the same time, the following problems may occur: for a Virtual Machine (VM) in a server, data messages in two directions of the same Session entering and exiting the VM may pass through different virtual switches, so that for a stateful service scenario, feedback (action) in one direction depends on a message coming in the opposite direction; if the access paths are not consistent, the virtual switch is lack of dependence, unexpected feedback may be generated, and a problem of software implementation logic may be caused, or for the case that the user accesses the server using the browser, the last message is that the user logs in the server using the user name and the password, and a response message of successful login of the server reaches an interface of another network card through the same virtual switch, so that the network card cannot return the message to the virtual machine initiating the login request, and the login operation only can obtain a failure result.
In order to avoid the above situation, the embodiments of the present disclosure provide the following detailed description.
In an embodiment, the above steps determine the interface on the network card that needs to process the data packet, and when the method is implemented specifically, the method may be implemented by the following steps:
1. determining IP quintuple information in an uplink data message;
IP quintuple information, comprising: source IP address, source port, destination IP address, destination port, and transport layer protocol. For example: 192.168.1.110000TCP 121.14.88.7680 constitutes an IP quintuple. It means that a terminal with an IP address of 192.168.1.1 is connected via port 10000 using the TCP protocol (transport layer protocol) and a terminal with an IP address of 121.14.88.76 and a port of 80.
2. And searching a sending interface corresponding to the determined IP quintuple information from a mapping relation between the pre-stored IP quintuple information and a sending interface identifier according to the determined IP quintuple information.
In specific implementation, for convenience of query, the mapping relationship between the IP quintuple information and the sending interface identifier may be stored in the database in a mapping relationship table.
The IP quintuple information in the uplink data message comprises the following components: source IP address, source port, destination IP address, destination port, and transport layer protocol. And after the IP quintuple information is extracted from the uplink data message, searching the identifier of the sending interface corresponding to the extracted IP quintuple information according to the mapping relation of the prestored IP quintuple information and the identifier of the sending interface.
In order to ensure that the paths of the messages entering and exiting in different directions of the same Session are consistent, in the embodiment of the disclosure, a mapping relationship between an IP quintuple and the network card upper interface identifier is pre-stored, and when an uplink data message is sent, by querying the mapping relationship, a receiving interface of a downlink data message which is received last time and belongs to the same Session at this time can be used to send the uplink data message.
Because the quantity of IP quintuple information that the server and the virtual switch need to support is huge, for example, it can reach millions of orders in some scenarios, in this case, a simple network card itself, or a Memory of the virtual switch itself (such as a Static Random-Access Memory (SRAM)) may be difficult to support such a large Data storage amount, and therefore, a plug-in Memory, such as a Memory supporting fast reading and writing, such as a Double-Rate synchronous dynamic Random Access Memory (Double Data Rate SDRAM), may be adopted to store the IP quintuple information with huge Data volume and the information of the identifier of the interface, so as to meet the requirement of Data forwarding.
Before the step of searching for the sending interface corresponding to the determined IP quintuple information, referring to fig. 5, the following steps may be performed:
s51, determining the state corresponding to the IP quintuple information as an initial state or a non-initial state; if the state is the initial state, the following step S52 is executed; otherwise, the following step S53 is executed;
the initial state represents that the uplink data message containing the IP quintuple information is not sent, and the non-initial state represents that the uplink data message containing the IP quintuple information is sent;
s52, selecting a sending interface from each interface of the network card, and creating a mapping relation between IP quintuple information of the data message and a sending interface identifier;
if the IP quintuple has never sent the corresponding uplink data packet, the sending interface may be selected in multiple possible ways, for example, a default interface is pre-selected for each IP quintuple information, and in the initial state of the unsent data packet, the preset default interface is directly used.
Or other selection means are adopted, for example, hash operation (hash) is performed on each IP quintuple information, and an interface which needs to send the uplink data message is selected from the interfaces of the network card according to the hash operation result.
However, the embodiments of the present disclosure do not limit the specific ways of selecting the interface for sending the uplink report from the interfaces of the network card, and any realizable way may be adopted.
S53, searching a sending interface corresponding to the determined IP quintuple information from the mapping relation of the prestored IP quintuple information and the sending interface identifier.
When the data packet corresponding to a certain IP quintuple information is in a non-initial state, and a long time passes, assuming that a preset duration is not received, the state of the data packet may be updated to the initial state again.
In order to ensure that an uplink data packet and a downlink data packet of the same Session pass through the same path, that is, pass through the same vSwitch, so as to prevent a stateful service from generating an unexpected response (action), in the generation process of the mapping relationship between the IP quintuple information and the sending interface, the sending interface is ensured to be a receiving interface of the downlink data packet of the same Session through the following processes:
when a network card of a server receives downlink data forwarded by a connected virtual switch, determining whether the downlink data message and an uplink data message belong to the same session according to IP five-tuple information of the downlink data message; if yes, replacing the sending interface identifier in the mapping relation between the IP quintuple information of the uplink data message and the sending interface identifier by using the receiving interface identifier of the downlink data message.
In the above process, when the downlink data packet is received, because the source IP address and the destination IP address in the IP quintuple information of the uplink data packet and the downlink data packet belonging to the same Session are opposite, that is, in the IP quintuple information of the uplink data packet, the source IP address is the destination IP address of the downlink data packet, the destination IP address is the source IP address of the downlink data packet, the source port is the destination port of the downlink data packet, and the destination port is the source port of the downlink data packet. Therefore, according to the IP quintuple information extracted from the downlink data packet, the IP quintuple information of the uplink data packet belonging to the same Session as the downlink data packet can be known, so that the sending interface identifier in the mapping relationship between the IP quintuple information and the sending interface identifier can be modified into the identifier of the receiving interface of the downlink data packet.
Through the processing, the IP quintuple information and the sending interface identifier in the mapping relation of the sending interface identifier can be kept consistent with the interface identifier of the downlink data message of the same session received last time in real time, so that the uplink data message and the downlink data message of the same session can enter and exit the same interface, the correct request and response of the stateful service can be ensured, and the correctness of the logic realization of the stateful service can be ensured.
In one embodiment, after a network card of a server determines a sending interface according to the mapping relationship between the IP quintuple information and a sending interface identifier, if it is determined that an interface which needs to forward an uplink data message fails, the uplink data message is sent to a virtual switch on another set-top switch connected to the interface which does not fail through an interface which does not fail in the network card for forwarding;
in order to continuously keep the same interface in and out for the sending and receiving of the subsequent messages, the mapping relation between the IP five-tuple information and the sending interface identifier needs to be modified, and based on the mapping relation, when the downlink data messages of the same conversation of the uplink data messages are received from the interface without faults, the sending interface identifier in the mapping relation between the IP five-tuple information of the uplink data messages and the sending interface identifier is replaced by using the identifier of the interface without faults.
If the subsequent failed interface recovers again, due to a fault reporting mechanism of the network card, when the interface recovers, the downlink data message also needs to be received again from the recovered interface, at the moment, if the network card determines that the failed interface recovers and the downlink data message received from the recovered interface, the IP quintuple information in the downlink data message is extracted, and the identifier of the recovered interface is recorded;
and according to the IP quintuple information extracted from the downlink data message, determining the IP quintuple information corresponding to the uplink data message belonging to the same session with the downlink data message by utilizing the interchange relationship of the source IP, the destination IP, the source port, the destination port and the like, and then replacing the sending interface identifier in the mapping relationship between the IP quintuple information and the sending interface identifier by using the recovered interface identifier.
For example, assuming that the downlink data packet is received via the recovered Port1, according to the IP quintuple information in the downlink data packet: 192.168.1.110000TCP 121.14.88.7680 can find out the corresponding IP quintuple information corresponding to the uplink data message belonging to the same session, namely: 121.14.88.7680 TCP 192.168.1.110000, then find the mapping relation between the IP five-tuple information and the sending interface identification, and modify the sending interface identification Port2 into Port 1.
The embodiment of the present disclosure further provides another data forwarding method, which is applied to a virtual switch side, and as shown in fig. 6, the method includes the following steps:
s61, the virtual switch receives the uplink data message forwarded by the network card of the server;
and S62, after the virtual switch processes the uplink data message by the data link layer, the virtual switch forwards the uplink data message by the set-top switch where the virtual switch is located.
The data forwarding method provided in the embodiment of the present invention improves the existing network access architecture and data forwarding manner, but it should be noted that the inventive concept is not limited to the implementation of the specific architecture and data forwarding among the server, the virtual switch, and the set-top switch, and can be widely applied to various possible network types, such as various public clouds, private clouds, and public-private hybrid clouds, etc., the execution main body and the participating object of the method can be devices in the various types of networks, such as an intelligent network card, an intelligent access gateway, a virtual switch, etc., and the flow of the embodiment of the present invention can be executed and the corresponding technical effect can be achieved, which is not limited in the embodiment of the present invention.
In order to better explain the data forwarding method provided by the embodiments of the present disclosure, two simple examples are described here, and in the two embodiments, a cloud server is taken as an example.
The first embodiment is as follows:
referring to an architecture diagram shown in fig. 7, in an example of a network architecture to which the first embodiment of the present disclosure is applied, network cards in a plurality of cloud servers (cloud server 1 to cloud server 3) in a cabinet 1 are all connected to virtual switches in a Bypass (Bypass) manner, each cabinet is equipped with two virtual switches, each switch is integrated in a set-top switch, and a plurality of set-top switches are connected to the same aggregation switch.
In the cloud server, a plurality of virtual machines are connected to a network through network devices such as a network card, a virtual switch, a set-top switch and a convergence switch of the cloud server.
The network card of the cloud server is a double-interface network card, each interface is connected with a virtual switch, and the identifiers of the interfaces are Port1 and Port 2; the connected virtual switches are virtual machine switch 1 and virtual switch 2, respectively.
In the internal memory of the network card, a table of the mapping relationship between the huge number of IP quintuple information and the sending interface identifier is stored, and the sending interface corresponding to any IP quintuple information can be determined through table lookup, and the table lookup process is called export lookup (Tx Port look up).
For each IP quintuple information, it corresponds to an identifier of an interface, and also has a state, an initial state or a non-initial state, where an initial state means that the IP quintuple information has never sent a message, and a non-initial state means that the IP quintuple information has sent a message.
When the virtual machine 1 in the cloud server 1 forwards the first uplink data packet of a certain session through the network card, the network card extracts IP quintuple information of the uplink data packet, that is: 192.168.1.110000TCP 121.14.88.7680, and enquires the state of IP quintuple information, if it is the initial state, it carries out Hash operation according to the IP quintuple information, according to the result of Hash operation, selects Port2 from Port1 and Port2 as sending interface, and creates the mapping relation between the IP quintuple information and the sending interface identification, and modifies the initial state into non-initial state.
When a downlink data message belonging to the same session with an uplink data message is forwarded to a set-top switch from a convergence switch, then the set-top switch is forwarded to a virtual switch 1, and is forwarded to a Port1 of a network card of a cloud server 1 through the virtual switch 1, the network card extracts IP quintuple information 121.14.88.7680 TCP 192.168.1.110000 of the downlink data message, interchanges a source IP and a destination IP, and interchanges a source Port and a destination Port to obtain IP quintuple information of the uplink data message of the same session, namely 192.168.1.110000TCP 121.14.88.7680, searches a corresponding entry from a mapping relation table of the stored IP quintuple information and a sending interface identifier, and updates a Port2 therein to a Port 1.
At the same time, the network card sends downstream data messages to virtual machine 1 using port 1.
The virtual machine 1 sends the uplink data message of the same session to the network card of the cloud server 1 again, after the network card reads the IP quintuple information of the uplink data message, the network card queries the mapping relation table of the stored IP quintuple information and the sending interface identifier, determines that the sending interface is Port1, forwards the IP quintuple information to the virtual switch 1 through the Port1 of the network card, processes the data link layer, sends the IP quintuple information to the aggregation switch through the set-top switch 1, and further forwards the IP quintuple information by subsequent routing and the like until the destination server is reached.
Through the operation, the sending interface of the same uplink data message is always consistent with the receiving interface of the last downlink data message, so that the smooth proceeding of the session of the stateful service and the correctness of the realization logic of the software are ensured.
Example two:
still referring to the network architecture of fig. 7, the network architecture to which the second embodiment of the present disclosure is applied is the same as the first embodiment, and the data forwarding process is also similar, in the second embodiment, when the uplink data packet needs to be forwarded, the network card checks that the Port1 interface of the network card suddenly fails, and cannot forward the uplink data packet normally, and at this time, the network card forwards the uplink data packet through the Port2 interface that does not fail.
The network card reports the message after the Port1 interface fails, so that the returned downlink data message is prevented from being forwarded to the virtual switch 1 and the set-top switch 1 connected with the Port1, and thus, the subsequent downlink data message is forwarded to the interface Port2 on the network card of the cloud server 1 from the virtual switch 2 and the set-top switch 2, when the downlink data message is subsequently received from the interface Port2, the IP quintuple information of the downlink data message is extracted, and after the source IP, the destination IP, the source Port and the destination Port are exchanged, the IP quintuple information of the corresponding uplink data message is obtained, a mapping table is searched, and the originally recorded Port1 is updated to be the Port 2.
Thus, the interface that sends the upstream data packet and the interface that receives the downstream data packet are both ports 2. Once the Port1 interface is recovered to normal, the message for recovering normal is further reported to the set-top switch and the aggregation switch, so that the downlink data packet is also sent to the Port1 interface of the cloud server 1 network card through the virtual switch 1, at this time, the IP quintuple information in the received downlink data packet is extracted, and the identifier of the Port1 interface is recorded;
and determining IP quintuple information corresponding to an uplink data message belonging to the same session with a downlink data message according to the extracted IP quintuple information, and replacing a sending interface identifier in the mapping relation between the IP quintuple information of the uplink data message and the sending interface identifier by using an identifier of a Port1 interface. The subsequent operations are again the same as the first embodiment, and are not described again here.
Based on the same inventive concept, the embodiments of the present disclosure further provide a data forwarding device, a network card and a server, a data forwarding system and a switch, and because the principles of the problems solved by these devices and systems are similar to the foregoing data forwarding method, the implementation of the devices and systems may refer to the implementation of the foregoing method, and repeated details are not repeated.
An apparatus for forwarding data provided in an embodiment of the present disclosure, as shown in fig. 8, includes:
the interface determining module 81 is configured to receive an uplink data packet sent by a virtual machine, and determine an interface that needs to process the uplink data packet;
and a forwarding module 82, configured to send the uplink data packet to a virtual switch connected to the interface via the interface according to the determined interface, and forward the uplink data packet.
In an embodiment, the interface determining module 81 is specifically configured to determine IP quintuple information in the uplink data packet; and searching a sending interface corresponding to the determined IP quintuple information from a mapping relation between the pre-stored IP quintuple information and a sending interface identifier according to the determined IP quintuple information.
In one embodiment, the data forwarding apparatus further includes: a state determination module 83 and a creation module 84, wherein:
a state determining module 83, configured to determine that a state corresponding to the IP quintuple information is an initial state or a non-initial state before the interface determining module 81 searches for a sending interface corresponding to the determined IP quintuple information from a mapping relationship between pre-stored IP quintuple information and a sending interface identifier, where the initial state represents that an uplink data packet including the IP quintuple information is not sent, and the non-initial state represents that an uplink data packet including the IP quintuple information is sent;
a creating module 84, configured to create a mapping relationship between IP quintuple information of the data packet and a sending interface identifier when the state determining module 83 determines that the data packet is in the initial state;
the forwarding module 82 is further configured to select a sending interface from the interfaces of the network card when the state determining module 83 determines that the state is the initial state; and when the state determining module 83 determines that the state is the non-initial state, switching to a step of searching for a sending interface corresponding to the determined IP quintuple information from a mapping relationship between the IP quintuple information and a sending interface identifier stored in advance.
The forwarding module 82 further performs hash operation based on IP quintuple information of the data packet to be sent when the state determination module 83 determines that the data packet is in the initial state; and selecting a sending interface from the interfaces of the network card according to the hash operation result.
In one embodiment, the data forwarding apparatus further includes: an interface identifier update module 85;
the forwarding module 82 is further configured to, when receiving a downlink data packet forwarded by the connected virtual switch, extract IP quintuple information in the downlink data packet;
the interface identifier updating module 85 is configured to determine whether the downlink data packet and the uplink data packet belong to the same session according to IP quintuple information of the downlink data packet; and if so, replacing the transmitting interface identifier in the mapping relation between the IP quintuple information of the uplink data message and the transmitting interface identifier by using the receiving interface identifier of the downlink data message.
The embodiment of the present disclosure further provides a network card, including: memory, processor and computer instructions stored on the memory and executable on the processor, wherein the instructions when executed by the processor are capable of implementing the aforementioned method of data forwarding.
The network card can have a Bypass function, and can directly send the data message to the virtual switch without processing of a data link layer.
The embodiment of the disclosure also provides a server, wherein the network card is arranged on the server.
The server may be adapted for use with various clouds, such as a public cloud, a private cloud, or a hybrid cloud, among others.
An embodiment of the present disclosure further provides a system for forwarding data, which is shown in fig. 2 and includes: at least one server, a virtual switch and a set-top switch; the virtual switch is arranged in the top switch;
the server is provided with at least one virtual machine, and a network card of the server is connected with the virtual switch; the server is used for determining an interface on the network card, which needs to process the uplink data message, when the network card receives the uplink data message sent by the connected virtual machine; according to the determined interface, the uplink data message is sent to a virtual switch connected with the interface through the interface;
and the virtual switch is used for forwarding the uplink data messages through the top switch after the uplink data messages are processed by the data link layer.
In one embodiment, the system comprises at least two of the set-top switches and at least two of the virtual switches; the more than two virtual switches are respectively arranged in the more than two top switches;
the network card on the server is provided with at least two interfaces, and the interfaces are respectively connected with different virtual switches and the set-top switch.
The embodiment of the present disclosure further provides a switch, which includes: memory, processor and computer instructions stored on the memory and executable on the processor, wherein the instructions when executed by the processor are capable of implementing the aforementioned method of data forwarding.
The switch may be a virtual switch or a physical switch implemented in combination of hardware and software.
The virtual switch implemented by combining software and hardware can be implemented by adopting an embedded chip, for example.
The disclosed embodiments also provide a computer readable storage medium having stored thereon computer instructions, which when executed by a processor, can implement the method of implementing the aforementioned data forwarding as claimed.
As will be appreciated by one skilled in the art, embodiments of the present disclosure may be provided as a method, system, or computer program product. Accordingly, the present disclosure may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present disclosure may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, optical storage, and the like) having computer-usable program code embodied therein.
The present disclosure is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the disclosure. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be apparent to those skilled in the art that various changes and modifications can be made in the present disclosure without departing from the spirit and scope of the disclosure. Thus, if such modifications and variations of the present disclosure fall within the scope of the claims of the present disclosure and their equivalents, the present disclosure is intended to include such modifications and variations as well.

Claims (16)

1. A method for forwarding data, comprising:
receiving an uplink data message sent by a virtual machine, and determining an interface of the uplink data message to be processed;
and sending the uplink data message to a virtual switch connected with the interface through the interface for forwarding according to the determined interface.
2. The method of claim 1, wherein determining an interface for processing the data packet comprises:
determining IP quintuple information in the uplink data message;
and searching a sending interface corresponding to the determined IP quintuple information from a mapping relation between the pre-stored IP quintuple information and a sending interface identifier according to the determined IP quintuple information.
3. The method according to claim 2, wherein before searching for a sending interface corresponding to the determined IP quintuple information from a mapping relationship between pre-stored IP quintuple information and a sending interface identifier, further comprising:
determining that the state corresponding to the IP quintuple information is an initial state or a non-initial state, wherein the initial state represents that an uplink data message containing the IP quintuple information is not sent, and the non-initial state represents that an uplink data message containing the IP quintuple information is sent;
if the data message is determined to be in the initial state, selecting a sending interface from the interfaces of the network card, and creating a mapping relation between IP five-tuple information of the data message and a sending interface identifier;
if the IP quintuple information is determined to be in the non-initial state, the step of searching the sending interface corresponding to the determined IP quintuple information from the mapping relation of the pre-stored IP quintuple information and the sending interface identifier is carried out.
4. The method of claim 3, wherein selecting a transmission interface from the interfaces of the network card if the initial state is determined, comprises:
based on IP quintuple information of the data message to be sent, carrying out hash operation;
and selecting a sending interface from the interfaces of the network card according to the hash operation result.
5. The method of claim 2, wherein the method further comprises:
when receiving downlink data forwarded by a connected virtual switch, determining whether the downlink data message and the uplink data message belong to the same session according to IP five-tuple information of the downlink data message;
and if so, replacing the transmitting interface identifier in the mapping relation between the IP quintuple information of the uplink data message and the transmitting interface identifier by using the receiving interface identifier of the downlink data message.
6. The method of any one of claims 1 to 5, further comprising:
if the network card determines that the interface needing to forward the uplink data message is in fault, the network card selects the interface which is not in fault in the network card and sends the uplink data message to the virtual switch on the other set-top switches connected with the interface which is not in fault for forwarding;
and when a downlink data message of the same session of the uplink data message is received from the interface without the fault, replacing the sending interface identifier in the mapping relation between the IP quintuple information of the uplink data message and the sending interface identifier by using the identifier of the interface without the fault.
7. The method of claim 6, wherein the method further comprises:
if the failed interface is recovered and the downlink data message received from the recovered interface is determined, extracting IP five-tuple information in the downlink data message and recording the identifier of the recovered interface;
and determining IP quintuple information corresponding to an uplink data message which belongs to the same session with the downlink data message according to the extracted IP quintuple information, and replacing a sending interface identifier in the mapping relation between the IP quintuple information of the uplink data message and the sending interface identifier by using the identifier of the recovered interface.
8. The method according to any one of claims 1 to 5, wherein the data forwarding method is performed by a network card, and the network card forwards the upstream data packet to the virtual switch on the set-top switch in a bypass manner or receives the downstream data packet from the virtual switch on the set-top switch.
9. A method for forwarding data, comprising:
the virtual switch receives an uplink data message forwarded by a network card of the server;
and after the virtual switch processes the uplink data message by the data link layer, forwarding the uplink data message by the set-top switch where the virtual switch is located.
10. An apparatus for data forwarding, comprising:
the interface determining module is used for receiving an uplink data message sent by the virtual machine and determining an interface which needs to process the uplink data message;
and the forwarding module is used for sending the uplink data message to a virtual switch connected with the interface through the interface for forwarding according to the determined interface.
11. A network card, comprising: memory, processor and computer instructions stored on the memory and executable on the processor, wherein the instructions when executed by the processor are capable of implementing a method of data forwarding according to any one of claims 1 to 8.
12. A server, characterized in that the network card of claim 11 is arranged on the server.
13. A system for data forwarding, comprising: at least one server, a virtual switch and a set-top switch; the virtual switch is arranged in the top switch;
the server is provided with at least one virtual machine, and a network card of the server is connected with the virtual switch; the server is used for determining an interface on the network card, which needs to process the uplink data message, when the network card receives the uplink data message sent by the connected virtual machine; according to the determined interface, the uplink data message is sent to a virtual switch connected with the interface through the interface;
and the virtual switch is used for forwarding the uplink data messages through the top switch after the uplink data messages are processed by the data link layer.
14. The system of claim 13, wherein the system comprises at least two of the set-top switches and at least two virtual switches; the more than two virtual switches are respectively arranged in the more than two top switches;
the network card on the server is provided with at least two interfaces, and the interfaces are respectively connected with different virtual switches and the set-top switch.
15. A switch, comprising: memory, processor and computer instructions stored on the memory and executable on the processor, wherein the instructions when executed by the processor are capable of implementing the method of data forwarding according to claim 9.
16. A computer readable storage medium having stored thereon computer instructions, which when executed by a processor, are capable of implementing a method of data forwarding according to any one of claims 1 to 8, or of data forwarding according to claim 9.
CN202010526434.0A 2020-06-09 2020-06-09 Data forwarding method, device and system Active CN113783910B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010526434.0A CN113783910B (en) 2020-06-09 2020-06-09 Data forwarding method, device and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010526434.0A CN113783910B (en) 2020-06-09 2020-06-09 Data forwarding method, device and system

Publications (2)

Publication Number Publication Date
CN113783910A true CN113783910A (en) 2021-12-10
CN113783910B CN113783910B (en) 2024-02-13

Family

ID=78834927

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010526434.0A Active CN113783910B (en) 2020-06-09 2020-06-09 Data forwarding method, device and system

Country Status (1)

Country Link
CN (1) CN113783910B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114401216A (en) * 2022-01-17 2022-04-26 中国工商银行股份有限公司 Flow forwarding method and device, electronic equipment and computer readable storage medium
CN114500411A (en) * 2021-12-30 2022-05-13 长园深瑞继保自动化有限公司 Data forwarding system, method, computing device and programmable logic device
CN114500173A (en) * 2022-02-17 2022-05-13 新华三技术有限公司合肥分公司 Message processing method and device, electronic equipment and storage medium

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103023827A (en) * 2012-11-23 2013-04-03 杭州华三通信技术有限公司 Data forwarding method for virtualized data centre and realization equipment of data forwarding method
CN103607308A (en) * 2013-11-29 2014-02-26 杭州东信北邮信息技术有限公司 Virtual machine multi-network management system and method in cloud computing environment
CN104486234A (en) * 2014-11-21 2015-04-01 华为技术有限公司 Method and server for uninstalling service exchanger to physical network card
WO2016115698A1 (en) * 2015-01-21 2016-07-28 华为技术有限公司 Data packet forwarding method, apparatus and device
CN107018058A (en) * 2017-03-30 2017-08-04 国家计算机网络与信息安全管理中心 The method and system of VLAN and VXLAN communications are shared under a kind of cloud environment
CN107147574A (en) * 2016-03-01 2017-09-08 深圳市深信服电子科技有限公司 Message forwarding method and system based on distributed virtual router
CN107483369A (en) * 2017-09-13 2017-12-15 郑州云海信息技术有限公司 A kind of message processing method and virtual switch
CN107885573A (en) * 2016-09-29 2018-04-06 华为技术有限公司 A kind of control method of data traffic, controller and data center systems
CN109361608A (en) * 2018-11-23 2019-02-19 北京六方领安网络科技有限公司 Message processing method, system and storage medium

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103023827A (en) * 2012-11-23 2013-04-03 杭州华三通信技术有限公司 Data forwarding method for virtualized data centre and realization equipment of data forwarding method
CN103607308A (en) * 2013-11-29 2014-02-26 杭州东信北邮信息技术有限公司 Virtual machine multi-network management system and method in cloud computing environment
CN104486234A (en) * 2014-11-21 2015-04-01 华为技术有限公司 Method and server for uninstalling service exchanger to physical network card
WO2016115698A1 (en) * 2015-01-21 2016-07-28 华为技术有限公司 Data packet forwarding method, apparatus and device
CN107147574A (en) * 2016-03-01 2017-09-08 深圳市深信服电子科技有限公司 Message forwarding method and system based on distributed virtual router
CN107885573A (en) * 2016-09-29 2018-04-06 华为技术有限公司 A kind of control method of data traffic, controller and data center systems
CN107018058A (en) * 2017-03-30 2017-08-04 国家计算机网络与信息安全管理中心 The method and system of VLAN and VXLAN communications are shared under a kind of cloud environment
CN107483369A (en) * 2017-09-13 2017-12-15 郑州云海信息技术有限公司 A kind of message processing method and virtual switch
CN109361608A (en) * 2018-11-23 2019-02-19 北京六方领安网络科技有限公司 Message processing method, system and storage medium

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114500411A (en) * 2021-12-30 2022-05-13 长园深瑞继保自动化有限公司 Data forwarding system, method, computing device and programmable logic device
CN114401216A (en) * 2022-01-17 2022-04-26 中国工商银行股份有限公司 Flow forwarding method and device, electronic equipment and computer readable storage medium
CN114401216B (en) * 2022-01-17 2024-01-30 中国工商银行股份有限公司 Traffic forwarding method and device, electronic equipment and computer readable storage medium
CN114500173A (en) * 2022-02-17 2022-05-13 新华三技术有限公司合肥分公司 Message processing method and device, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN113783910B (en) 2024-02-13

Similar Documents

Publication Publication Date Title
US11271892B2 (en) Network communication method and system, device, and storage medium
CN113783910B (en) Data forwarding method, device and system
US20240031309A1 (en) Data Processing Method, Apparatus, Device and Storage Medium
CN111193773B (en) Load balancing method, device, equipment and storage medium
CN111314450B (en) Data transmission method and device, electronic equipment and computer storage medium
CN109525684B (en) Message forwarding method and device
CN103631652A (en) Method and system for achieving virtual machine migration
CN113839862B (en) Method, system, terminal and storage medium for synchronizing ARP information between MCLAG neighbors
WO2015043679A1 (en) Moving stateful applications
CN113301079B (en) Data acquisition method, system, computing device and storage medium
CN112087382B (en) Service routing method and device
CN116962441A (en) Cloud storage control method and device and cloud storage system
CN115242882A (en) Method and device for accessing k8s container environment based on transport layer route
US20210203604A1 (en) Load balancing method, device and system
CN111404705B (en) SDN optimization method and device and computer readable storage medium
CN109450794B (en) Communication method and device based on SDN network
CN113918326A (en) Request processing method and device
CN106487643A (en) A kind of information storage means of instant messaging and device
CN115174581B (en) Load balancing method and router
CN115378868B (en) System and method for realizing message processing based on SNAT resource pool
CN113973086B (en) Data transmission method, device and storage medium
CN111835735B (en) Anti-attack method, device, equipment and machine-readable storage medium
US11956302B1 (en) Internet protocol version 4-to-version 6 redirect for application function-specific user endpoint identifiers
CN114760263B (en) Address resolution method, cloud platform and medium
CN112866106B (en) Interest packet caching method, device, equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 40063322

Country of ref document: HK

GR01 Patent grant
GR01 Patent grant