CN112822060B - Host network construction method, device, system, medium and host - Google Patents

Host network construction method, device, system, medium and host Download PDF

Info

Publication number
CN112822060B
CN112822060B CN202110196294.XA CN202110196294A CN112822060B CN 112822060 B CN112822060 B CN 112822060B CN 202110196294 A CN202110196294 A CN 202110196294A CN 112822060 B CN112822060 B CN 112822060B
Authority
CN
China
Prior art keywords
network
network card
address
card
host
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110196294.XA
Other languages
Chinese (zh)
Other versions
CN112822060A (en
Inventor
文旭
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ucloud Technology Co ltd
Original Assignee
Ucloud Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ucloud Technology Co ltd filed Critical Ucloud Technology Co ltd
Priority to CN202110196294.XA priority Critical patent/CN112822060B/en
Publication of CN112822060A publication Critical patent/CN112822060A/en
Application granted granted Critical
Publication of CN112822060B publication Critical patent/CN112822060B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/08Configuration management of networks or network elements
    • H04L41/0803Configuration setting
    • H04L41/0823Configuration setting characterised by the purposes of a change of settings, e.g. optimising configuration for enhancing reliability
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/455Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533Hypervisors; Virtual machine monitors
    • G06F9/45558Hypervisor-specific management and integration aspects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/08Configuration management of networks or network elements
    • H04L41/0893Assignment of logical groups to network elements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L49/00Packet switching elements
    • H04L49/70Virtual switches
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/455Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533Hypervisors; Virtual machine monitors
    • G06F9/45558Hypervisor-specific management and integration aspects
    • G06F2009/45595Network integration; Enabling network access in virtual machine instances

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

The present invention relates to a method, apparatus, system, medium, and host for constructing a host network. The method for constructing the host network comprises the following steps: binding, namely binding a plurality of physical network cards into a logical network card by using a binding technology, wherein the logical network card corresponds to a plurality of virtual network cards; an allocation step of selecting a virtual network card from the plurality of virtual network cards and allocating the selected virtual network card to a first network; and a configuration step, namely configuring an unloading forwarding rule associated with the selected virtual network card on the logic network card, so that the selected virtual network card forwards the message according to the unloading forwarding rule. According to the invention, the SDN network and the RDMA network on the host can share the bottom layer physical network card, so that the simplification of network management is realized, and a virtual network card which is almost doubled can be virtualized based on the two physical network cards for the use of a virtual machine, so that the maximum utilization of resources is realized.

Description

Host network construction method, device, system, medium and host
Technical Field
The present invention relates to a method, apparatus, system, medium, and host for constructing a host network.
Background
With the continuous development of cloud computing, an intelligent Network card becomes a standard Network card for cloud computing, an SDN (Software Defined Network) Network on a host performs optimization and acceleration through an offload technology of the intelligent Network card, and an RDMA (Remote Direct Memory Access) Network on the host performs optimization and acceleration through an RDMA technology of the intelligent Network card.
However, because RDMA networks must be transmitted based on a physical network, and the SDN network is inside the package of the physical network, the SDN network and RDMA networks on the host in the current industry are separately managed based on two different physical network cards, respectively, the SDN network uses the physical network card for forwarding, and the RDMA network uses another physical network card for RDMA network transmission.
The existing separation introduces management complications, requiring management of separate two physical network segments on the host. In addition, the number of virtual network cards which can be virtualized by a single physical network card is limited, the capacity of a virtual machine on a host is limited, and resources are not utilized to the maximum extent.
Disclosure of Invention
The invention aims to provide a method, a device, a system, a medium and a host for constructing a host network, which can enable an SDN network and an RDMA network on the host to share a bottom-layer physical network card, simplify network management, virtualize almost doubled virtual network cards based on the two physical network cards for a virtual machine to use, and realize the maximum utilization of resources.
The invention discloses a method for constructing a host network, which comprises the following steps:
binding, namely binding a plurality of physical network cards into a logical network card by using a binding technology, wherein the logical network card corresponds to a plurality of virtual network cards;
an allocation step of selecting a virtual network card from the plurality of virtual network cards and allocating the selected virtual network card to a first network;
and a configuration step, namely configuring an unloading forwarding rule associated with the selected virtual network card on the logic network card, so that the selected virtual network card forwards the message according to the unloading forwarding rule.
Optionally, the message sent to the selected virtual network card is diverted to the selected virtual network card, and the message sent from the selected virtual network card is diverted to the logic network card.
Optionally, the message sent to the logic network card and the message sent from the logic network card are encapsulated and forwarded through a virtual switch.
Optionally, the logical network card has a physical network address, and the selected virtual network card has a first network address, where the physical network address and the first network address are in the same network segment.
Optionally, the first network comprises an RDMA network.
The invention discloses a device for constructing a host network, which comprises:
the binding unit is used for binding a plurality of physical network cards into a logical network card by utilizing a binding technology, and the logical network card corresponds to a plurality of virtual network cards;
an allocation unit that selects a virtual network card from the plurality of virtual network cards and allocates the selected virtual network card to a first network;
and the configuration unit is used for configuring the uninstalling forwarding rule associated with the selected virtual network card on the logic network card so that the selected virtual network card forwards the message according to the uninstalling forwarding rule.
Optionally, the message sent to the selected virtual network card is diverted to the selected virtual network card, and the message sent from the selected virtual network card is diverted to the logic network card.
Optionally, the message sent to the logic network card and the message sent from the logic network card are encapsulated and forwarded through a virtual switch.
Optionally, the logical network card has a physical network address, and the selected virtual network card has a first network address, where the physical network address and the first network address are in the same network segment.
Optionally, the first network comprises an RDMA network.
The invention discloses a host which comprises a plurality of physical network cards and a host network constructing device.
The invention discloses a construction system of a host network, which comprises a memory and a processor, wherein the memory stores computer executable instructions, and the processor is configured to execute the instructions to implement a construction method of the host network.
A computer storage medium encoded with a computer program comprising instructions that are executed by one or more computers to implement a method of constructing a host network is disclosed.
Compared with the prior art, the invention has the main differences and the effects that:
according to the invention, the SDN network and the RDMA network on the host can share the bottom layer physical network card, so that the simplification of network management is realized, and almost doubled virtual network cards can be virtualized based on the two physical network cards for the use of a virtual machine, so that the maximum utilization of resources is realized.
Drawings
FIG. 1 is a block diagram of a building system of a host network according to an embodiment of the invention;
FIG. 2 is a block diagram including a host according to an embodiment of the present invention;
fig. 3 is a structural diagram of a construction apparatus of a host network according to an embodiment of the present invention;
fig. 4 is a flowchart of a method of constructing a host network according to an embodiment of the present invention.
Detailed Description
In order to make the purpose and technical solution of the embodiments of the present invention clearer, the technical solution of the embodiments of the present invention will be clearly and completely described below with reference to the drawings of the embodiments of the present invention. It should be apparent that the described embodiments are only some of the embodiments of the present invention, and not all of them. All other embodiments, which can be derived by a person skilled in the art from the described embodiments of the invention without any inventive step, are within the scope of protection of the invention.
In accordance with the present invention, there is provided an embodiment of a method of constructing a host network, it being noted that the steps illustrated in the flowchart of the figure may be performed in a computer system such as a set of computer-executable instructions and that, although a logical order is illustrated in the flowchart, in some cases the steps illustrated or described may be performed in an order different than here.
The method provided by the application mode can be executed in a mobile terminal, a computer terminal or a system. Taking the example of operation in a system, fig. 1 is a structural diagram of a construction system of a host network according to an embodiment of the present invention. As shown in fig. 1, the system 100 may include one or more (only one shown) processors 101 (the processor 101 may include, but is not limited to, a processing device such as a central processing unit CPU, an image processor GPU, a digital signal processor DSP, a microprocessor MCU, or a programmable logic device FPGA), an input-output interface 102 for interacting with a user, a memory 103 for storing data, and a transmission device 104 for communication functions. It will be understood by those skilled in the art that the structure shown in fig. 1 is only an illustration and is not intended to limit the structure of the electronic device. For example, system 100 may also include more or fewer components than shown in FIG. 1, or have a different configuration than shown in FIG. 1.
The input/output interface 102 may be coupled to one or more displays, touch screens, etc. for displaying data communicated from the system 100, and may also be coupled to a keyboard, stylus, touch pad, mouse, etc. for inputting user instructions such as selection, creation, editing, etc.
The memory 103 may be used to store a database, a queue, and software programs and modules of application software, such as program instructions/modules corresponding to the method for constructing a host network according to the embodiment of the present invention, and the processor 101 executes various functional applications and data processing by running the software programs and modules stored in the memory 103, so as to implement the method for constructing a host network. The memory 103 may include high speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 103 may further include memory located remotely from the processor 101, which may be connected to the system 100 over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The transmission device 104 is used to receive or transmit data via a network, which may include various connection types, such as wired, wireless communication links, or fiber optic cables, among others. Specific examples of such networks may include the internet provided by a communications provider of system 100.
Fig. 2 is a block diagram including a host according to an embodiment of the present invention. As shown in fig. 2, the host 200 includes a plurality of physical network cards and a host network constructing apparatus 201, and the plurality of physical network cards are, for example, physical network cards NIC1, NIC 2. In the example of fig. 2, only the physical network card NIC1 is shown, and NIC2 is for illustration.
Fig. 3 is a structural diagram of a construction apparatus of a host network according to an embodiment of the present invention. As shown in fig. 3, the construction apparatus 201 of the host network includes a binding unit 2011, an allocation unit 2012, and a configuration unit 2013.
Fig. 4 is a flowchart of a method of constructing a host network according to an embodiment of the present invention. An embodiment of the present invention will be described in detail below with reference to fig. 2 to 4.
In step S41, the binding unit 2011 binds the plurality of physical network cards to logical network cards by using a binding technique, where the logical network cards correspond to the plurality of virtual network cards.
As shown in fig. 2, the binding unit 2011 binds the physical network cards NIC1 and NIC2 to be logical network cards (i.e., binding devices). The logical network card has a physical network address, which is 172.168.1.7/24, for example.
In step S42, the allocating unit 2012 selects a virtual network card from among the plurality of virtual network cards and allocates the selected virtual network card to the first network.
As shown in fig. 2, the distribution unit 2012 selects a virtual network card VF0 from a plurality of virtual network cards. The selected virtual network card VF0 has a first network address, and the physical network address and the first network address are in the same network segment, and the first network address is, for example, 172.168.1.8/24. Wherein the first network comprises an RDMA network.
In step S43, the configuration unit 2013 configures the offload forwarding rule associated with the selected virtual network card on the logical network card, so that the selected virtual network card forwards the packet according to the offload forwarding rule.
As shown in fig. 2, the configuration unit 2013 configures the offload forwarding rule associated with the selected virtual network card VF0 on the logical network card, and issues the offload forwarding rule to the physical network card NIC1 and the physical network card NIC2, so that the selected virtual network card VF0 forwards the packet according to the offload forwarding rule.
The message sent to the selected virtual network card VF0 is diverted to the selected virtual network card VF0, and the message sent from the selected virtual network card VF0 is diverted to the logical network card. That is, the destination address is 172.168.1.8/24 message steering selected virtual network card VF0, and the source address is 172.168.1.8/24 message steering logical network card.
And the message sent to the logic network card and the message sent from the logic network card are subjected to tunnel encapsulation and forwarding through the virtual switch VSWITCH. Namely, the message with the destination address of 172.168.1.7/24 and the message with the source address of 172.168.1.7/24 are subjected to tunnel encapsulation and forwarding through the virtual switch VSWITCH.
According to the invention, the RDMA application can communicate with the virtual network card VF0, the cloud host VF1 can communicate with the logic network card through the virtual switch VSWITCH, and the SDN network and the RDMA network on the host can share the bottom layer physical network card, only one physical network segment needs to be managed on the host, thereby realizing the simplification of network management. In addition, a virtual network card which is almost doubled can be virtualized based on the two physical network cards NIC1 and NIC2 to be used by a virtual machine, so that the maximum utilization of resources is realized.
The present invention also provides a computer storage medium encoded with a computer program comprising instructions that are executed by one or more computers to implement the method of constructing a host network described above.
Each method embodiment of the present invention can be implemented by software, hardware, firmware, or the like. Whether the invention is implemented as software, hardware, or firmware, the instruction code may be stored in any type of computer-accessible memory (e.g., permanent or modifiable, volatile or non-volatile, solid or non-solid, fixed or removable media, etc.). Also, the Memory may be, for example, programmable Array Logic (PAL), random Access Memory (RAM), programmable Read Only Memory (PROM), read-Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), a magnetic disk, an optical disk, a Digital Versatile Disk (DVD), and so on.
It should be noted that, all units/modules mentioned in the embodiments of the apparatus of the present invention are logic units/modules, and physically, a logic unit may be a physical unit, or a part of a physical unit, or may be implemented by a combination of multiple physical units, and the physical implementation manner of the logic unit itself is not the most important, and the combination of functions implemented by the logic unit is the key to solve the technical problem provided by the present invention. In addition, in order to highlight the innovative part of the present invention, the above-mentioned embodiments of the apparatus of the present invention do not introduce elements that are not so closely related to solve the technical problems proposed by the present invention, which does not indicate that there are no other elements in the above-mentioned embodiments of the apparatus.
In the drawings, some features of the structures or methods may be shown in a particular arrangement and/or order. However, it is to be understood that such specific arrangement and/or ordering may not be required. Rather, in some embodiments, the features may be arranged in a manner and/or order different from that shown in the illustrative figures. In addition, the inclusion of a structural or methodical feature in a particular figure is not meant to imply that such feature is required in all embodiments, and in some embodiments, may not be included or may be combined with other features.
It is to be noted that in the claims and the description of the present patent, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
While the invention has been shown and described with reference to certain preferred embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention.

Claims (7)

1. A method of constructing a host network, the method comprising:
binding, namely binding a plurality of physical network cards into a logical network card by using a binding technology, wherein the logical network card corresponds to a plurality of virtual network cards;
an allocation step of selecting a virtual network card from the plurality of virtual network cards and allocating the selected virtual network card to a first network; a configuration step, in which an unloading forwarding rule associated with the selected virtual network card is configured on the logic network card, so that the selected virtual network card forwards a message according to the unloading forwarding rule;
the logic network card is provided with a physical network address, the selected virtual network card is provided with a first network address, and the physical network address and the first network address are in the same network segment;
wherein, the destination address is the message of the first network address and turns to the said virtual network card selected, the source address is the message of the said first network address turns to the said logical network card;
and the message with the destination address being the physical network address and the message with the source address being the physical network address are subjected to tunnel encapsulation and forwarding through a virtual switch.
2. The method of claim 1, wherein the first network comprises an RDMA network.
3. An apparatus for constructing a host network, the apparatus comprising:
the binding unit is used for binding a plurality of physical network cards into a logical network card by utilizing a binding technology, and the logical network card corresponds to a plurality of virtual network cards;
an allocation unit that selects a virtual network card from the plurality of virtual network cards and allocates the selected virtual network card to a first network; a configuration unit, configured with an offload forwarding rule associated with the selected virtual network card on the logic network card, so that the selected virtual network card forwards a message according to the offload forwarding rule;
the logic network card is provided with a physical network address, the selected virtual network card is provided with a first network address, and the physical network address and the first network address are in the same network segment;
the destination address is the virtual network card selected by the message steering of the first network address, and the source address is the logical network card selected by the message steering of the first network address;
and the message with the destination address being the physical network address and the message with the source address being the physical network address are subjected to tunnel encapsulation and forwarding through a virtual switch.
4. The apparatus of claim 3, wherein the first network comprises an RDMA network.
5. Host computer, characterized in that it comprises a plurality of physical network cards and building means of a host network according to any of claims 3-4.
6. A construction system of a host network, characterized in that the system comprises a memory storing computer executable instructions and a processor configured to execute the instructions to implement the construction method of a host network according to any one of claims 1-2.
7. A computer storage medium encoded with a computer program, the computer program comprising instructions that are executed by one or more computers to implement the method of constructing a host network according to any one of claims 1-2.
CN202110196294.XA 2021-02-22 2021-02-22 Host network construction method, device, system, medium and host Active CN112822060B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110196294.XA CN112822060B (en) 2021-02-22 2021-02-22 Host network construction method, device, system, medium and host

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110196294.XA CN112822060B (en) 2021-02-22 2021-02-22 Host network construction method, device, system, medium and host

Publications (2)

Publication Number Publication Date
CN112822060A CN112822060A (en) 2021-05-18
CN112822060B true CN112822060B (en) 2022-11-22

Family

ID=75864592

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110196294.XA Active CN112822060B (en) 2021-02-22 2021-02-22 Host network construction method, device, system, medium and host

Country Status (1)

Country Link
CN (1) CN112822060B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113676544A (en) * 2021-08-24 2021-11-19 优刻得科技股份有限公司 Cloud storage network and method for realizing service isolation in entity server
CN114374609B (en) * 2021-12-06 2023-09-15 东云睿连(武汉)计算技术有限公司 Deep learning job operation method and system based on RDMA equipment
CN114710774A (en) * 2022-03-04 2022-07-05 阿里云计算有限公司 Resource management method, device and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108829384A (en) * 2018-06-13 2018-11-16 平安科技(深圳)有限公司 Management method, device, computer equipment and the storage medium of container
CN110149231A (en) * 2019-05-21 2019-08-20 优刻得科技股份有限公司 Update method, apparatus, storage medium and the equipment of virtual switch
CN111556110A (en) * 2020-04-21 2020-08-18 贵州新致普惠信息技术有限公司 Automatic adaptation method for different physical service networks of private cloud system
CN111880901A (en) * 2020-07-29 2020-11-03 北京浪潮数据技术有限公司 Network configuration method, device, equipment and readable storage medium

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106209449A (en) * 2016-07-06 2016-12-07 天脉聚源(北京)传媒科技有限公司 A kind of method and device binding network interface card
CN108965169B (en) * 2018-07-12 2020-09-25 联想(北京)有限公司 Message transmission method, network card controller, network card and electronic equipment

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108829384A (en) * 2018-06-13 2018-11-16 平安科技(深圳)有限公司 Management method, device, computer equipment and the storage medium of container
CN110149231A (en) * 2019-05-21 2019-08-20 优刻得科技股份有限公司 Update method, apparatus, storage medium and the equipment of virtual switch
CN111556110A (en) * 2020-04-21 2020-08-18 贵州新致普惠信息技术有限公司 Automatic adaptation method for different physical service networks of private cloud system
CN111880901A (en) * 2020-07-29 2020-11-03 北京浪潮数据技术有限公司 Network configuration method, device, equipment and readable storage medium

Also Published As

Publication number Publication date
CN112822060A (en) 2021-05-18

Similar Documents

Publication Publication Date Title
CN112822060B (en) Host network construction method, device, system, medium and host
CN108293022B (en) Method, device and system for transmitting message
CN112217746B (en) Message processing method, host and system in cloud computing system
US10140066B2 (en) Smart partitioning of storage access paths in shared storage services
CN103733574B (en) For the method and gateway to communicate between virtualization network and non-virtualized entity
CN110809760B (en) Resource pool management method and device, resource pool control unit and communication equipment
CN109445905B (en) Virtual machine data communication method and system and virtual machine configuration method and device
CN108347477B (en) Data transmission method, device and server
CN109729106B (en) Method, system and computer program product for processing computing tasks
CN105094983A (en) Computer, control equipment and data processing method
CN111031011B (en) Interaction method and device of TCP/IP accelerator
CN104461698A (en) Dynamic virtual disk mounting method, virtual disk management device and distributed storage system
CN109857580A (en) Across the chain contract call method of block chain, device and storage medium
CN104769573A (en) Dynamically allocating network addresses
WO2014127668A1 (en) Method and device for configuring virtual machine and security group
CN114116205A (en) Resource management method and device based on kubernets, storage medium and electronic equipment
CN111262771B (en) Virtual private cloud communication system, system configuration method and controller
CN115934076B (en) Cross-platform client micro-service providing device and method and electronic equipment
CN114726657B (en) Interrupt management and data receiving and transmitting management method and device and intelligent network card
CN115665231A (en) Service creation method, device and computer-readable storage medium
CN114265869A (en) Data message forwarding method and device, storage medium and electronic equipment
CN108494700A (en) Across link data transmission method, device, computer equipment and storage medium
CN113612689A (en) Message forwarding method, system, device and medium
CN109542622A (en) A kind of data processing method and device
WO2023185570A1 (en) Storage driver for managing multiple layer file system on cloud

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant