KR20180000096A - System and method of providing remote file i/o using dedicated communication module for pci express network device on high performance computing system - Google Patents

System and method of providing remote file i/o using dedicated communication module for pci express network device on high performance computing system Download PDF

Info

Publication number
KR20180000096A
KR20180000096A KR1020160077814A KR20160077814A KR20180000096A KR 20180000096 A KR20180000096 A KR 20180000096A KR 1020160077814 A KR1020160077814 A KR 1020160077814A KR 20160077814 A KR20160077814 A KR 20160077814A KR 20180000096 A KR20180000096 A KR 20180000096A
Authority
KR
South Korea
Prior art keywords
file
output
remote
remote file
input
Prior art date
Application number
KR1020160077814A
Other languages
Korean (ko)
Inventor
최원혁
김원영
배승조
Original Assignee
한국전자통신연구원
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 한국전자통신연구원 filed Critical 한국전자통신연구원
Priority to KR1020160077814A priority Critical patent/KR20180000096A/en
Publication of KR20180000096A publication Critical patent/KR20180000096A/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F15/00—Digital computers in general; Data processing equipment in general
    • G06F15/16—Combinations of two or more digital computers each having at least an arithmetic unit, a program unit and a register, e.g. for a simultaneous processing of several programs
    • G06F15/163—Interprocessor communication
    • G06F15/17—Interprocessor communication using an input/output type connection, e.g. channel, I/O port
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/17—Details of further file system functions
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/18—File system types
    • G06F16/182—Distributed file systems
    • G06F16/1824—Distributed file systems implemented using Network-attached Storage [NAS] architecture
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/54—Interprogram communication
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2213/00—Indexing scheme relating to interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • G06F2213/0026—PCI express

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Computer Hardware Design (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The present invention utilizes a dedicated communication module for system inter-connector using a low-cost, high-performance PCI Express network device to store data generated at a high speed in a high performance computing system (HPC) such as a supercomputer in a remote system storage To a system and method for providing remote file input / output at a high speed at a kernel level.
In the HPC system according to the present invention, a system for providing a remote file input / output using a dedicated communication module for a PCI Express network device converts a remote file input / output API called by a file input / output application and a transfer factor into transmission data, And interprets the received remote file input / output command according to the driving of the client and the PCI Express network device according to the driving of the PCI Express network device, converts it into an actual API, and performs actual file input / output with the file system And a file server for storing the file information.

Figure P1020160077814

Description

TECHNICAL FIELD [0001] The present invention relates to a system and a method for providing a remote file input / output using a dedicated communication module for a PCI Express network device in an HPC system. [0002]

The present invention utilizes a dedicated communication module for system inter-connector using a low-cost, high-performance PCI Express network device to store data generated at a high speed in a high performance computing system (HPC) such as a supercomputer in a remote system storage To a system and method for providing remote file input / output at a high speed at a kernel level.

Current computing systems have become sophisticated and complex in order to provide various services to users.

To this end, the computing processor is developing in the form of multi / manifold in a single core, in addition to an increase in the number of clocks.

The performance of a computing system is constantly improving according to Moore's Law. On the other hand, the performance of a network in a large-scale high-performance system determines the performance of the entire system because the performance of the network connection between the systems does not follow the computing performance Has emerged as one of the important variables.

Currently, 1 / 10Gbps Ethernet is widely used in general networks, and it is evolving to 40 / 100Gbps Ethernet.

In high performance computing systems, interconnect technology using InfiniBand is widely applied.

PCI Express is commonly used as a system bus for connections between processors and I / O devices within a single computing node.

Today, PCI Express is capable of delivering up to 128 Gbps of performance in unidirectional (8 Gbps) performance on a single lane (x16) with 16 lanes.

Based on the characteristics of superior protocol efficiency, equivalent delay characteristics, low power consumption and low unit cost compared to other network interconnect technologies such as Ethernet and InfiniBand, such PCI Express provides a variety of interconnec- An attempt is being made.

However, the high speed dedicated network protocol used in the Infiniband technology is not provided, and the PCI Express communication based on the TCP / IP protocol for the general router based Ethernet communication has a disadvantage that it does not provide all the hardware supported performance.

Also, in case of remote file storage or input / output between systems in a network, a method of storing data in a remote file storage is used by transmitting data through an existing TCP / IP protocol and transmitting the data.

This may cause problems such as data loss because the protocol processing overhead and the data copying problem in the kernel do not provide sufficient performance for storing data generated at high speed.

SUMMARY OF THE INVENTION The present invention has been proposed in order to solve the above-mentioned problems. In order to store data generated at a high speed in a large-scale high-performance computing system in a remote file storage, the present invention solves the problem of high- In this paper, we propose a method to construct a connection network using PCI Express network device.

In addition, the present invention proposes a system and a method for storing a client's file at a high speed in a storage of a remote file server using a remote file input / output API through a dedicated communication module for a PCI Express network device.

In the HPC system according to the present invention, a system for providing a remote file input / output using a dedicated communication module for a PCI Express network device converts a remote file input / output API called by a file input / output application and a transfer factor into transmission data, And interprets the received remote file input / output command according to the driving of the client and the PCI Express network device according to the driving of the PCI Express network device, converts it into an actual API, and performs actual file input / output with the file system And a file server for storing the file information.

A method for providing a remote file input / output using a dedicated communication module for a PCI Express network device in a HPC system according to the present invention includes loading a SoPCIe module and a remote file input / output API processing module of a file server and generating a reception buffer Loading a SoPCIe module of a client and a remote file input / output API interpretation module of the client, and generating a reception buffer; receiving a remote file access command, a file write command, and a file read command according to a remote file input / And a file access termination command, and analyzing the remote file input / output command and processing the remote file access command, file writing, file reading, and file access termination by interpreting the remote file input / Performing physical file I / O with the system It characterized in that it comprises a system.

A system and method for providing a remote file input / output using a dedicated communication module for a PCI Express network device in a HPC system according to the present invention is a system and method for providing a remote file input / output in a PCI Express interconnect system having a high efficiency, low latency, low power, It is possible to reduce the overhead of the TCP / IP protocol processing, which is a general purpose communication protocol for Ethernet.

According to the present invention, by providing a method of storing a remote file at the kernel level of a file server using a dedicated communication module, it is possible to reduce the number of data copies in the kernel and application processing and minimize the transmission delay, There is an effect that it can be used.

The effects of the present invention are not limited to those mentioned above, and other effects not mentioned can be clearly understood by those skilled in the art from the following description.

1 is a block diagram illustrating a system for providing remote file input / output using a dedicated communication module for a PCI Express network device in an HPC system according to an embodiment of the present invention.
2 is a flowchart illustrating a method for providing a remote file input / output using a dedicated communication module for a PCI Express network device in an HPC system according to an embodiment of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS The above and other objects, advantages and features of the present invention and methods of achieving them will be apparent from the following detailed description of embodiments thereof taken in conjunction with the accompanying drawings.

The present invention may, however, be embodied in many different forms and should not be construed as being limited to the exemplary embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, And advantages of the present invention are defined by the description of the claims.

It is to be understood that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. In the present specification, the singular form includes plural forms unless otherwise specified in the specification. &Quot; comprises "and / or" comprising ", as used herein, unless the recited component, step, operation, and / Or added.

FIG. 1 is a block diagram illustrating a system for providing a remote file input / output using a dedicated communication module for a PCI Express network device in a HPC system according to an embodiment of the present invention. FIG. 2 is a block diagram of the HPC system according to an embodiment of the present invention. Is a flowchart illustrating a method for providing remote file input / output using a dedicated communication module for a PCI Express network device.

A system for providing a remote file input / output using a dedicated communication module for a PCI Express network device in a HPC system according to an embodiment of the present invention includes a remote file input / output API 120 called by a file input / output application 110, Converts the received remote file input / output command into the transmission data, converts it into a protocol for exclusive communication, and transmits the received remote file input / output command according to the driving of the client 100 and the PCI Express network device that are transmitted according to the driving of the PCI Express network device, And a file server 200 for performing an actual file input / output with the file system 210. [

Although only a single client 100 is shown in FIG. 1, according to an embodiment of the present invention, it is also possible that a plurality of clients are connected to a file server to perform remote file input / output.

The PCIeLink device driver 150 and the PCIeLink device driver 150 and the dedicated communication module SoPCIe 250 for the network using the PCIeLink hardware 160 and 260 for connection and communication between the client 100 and the file server 200 according to the embodiment of the present invention, Modules 140 and 240 are provided.

The client 100 and the server 200 each include SoPCIe modules 140 and 240 as dedicated communication modules and the SoPCIe modules 140 and 240 include a remote file input / output API interpretation module 130 and a remote file input / Converts the data transmitted from the API processing module 230 into a protocol for exclusive communication and transmits the data to the PCIeLink device drivers 150 and 250 that operate the PCIeLink hardware 160 and 260 as PCI Express network devices to transmit / Linux kernel level processing module to make

The connection management unit of the SoPCIe modules 140 and 240 collects hardware information and virtual network address information about itself and connection targets from the PCIeLink device drivers 150 and 250, generates a connection for PCIe, Creates and manages data structures for communication.

The SoPCIe modules 140 and 240 generate receive buffers 143 and 243 for data transmission and reception using the NTB (Non Transparent Bridge) remote memory sharing function provided by the PCIeLink hardware 160 and 260.

The data transmission and reception units 141 and 241 of the SoPCIe modules 140 and 240 receive the file input and output commands requested by the file input and output application 110 and the PCIeLink device drivers 150 and 250 And the PCIeLink hardware 160 and 260 to exchange data with each other.

The PCIeLink device drivers 150 and 250 are device driver modules for connecting and controlling the SoPCIe modules 140 and 240 and the PCIeLink hardware 160 and 260. The PCIeLink device drivers 150 and 250 convert and remotely host memory using the remote memory sharing function of the NTB. And controls a DMA or memory copy and a Doorbell register to process connection commands and data transmission / reception commands requested by the SoPCIe modules 140 and 240.

The client 100 includes a remote file input / output API interpretation module 130 and the file server 200 includes a remote file input / output processing module 230 to process remote file input / output.

The client 100 includes a remote file input / output API interpreting module 130 for converting the called remote file input / output API 120 and a transfer factor into transmission data for network transmission and delivering it to the SoPCIe module 140.

The remote file input / output API interpretation module 130 transmits either a remote file access command, a file write command, a file read command, or a file access termination command according to the remote file input / output API 120 called by the file input / output application 110 do.

The file input / output unit 232 of the remote file input / output processing module 230 of the file server 200 interprets the remote file I / O command received through the SoPCIe module 240 to access, And performs actual file input / output with the file system 210 of the file server 200 and transmits the result to the client 100 through the SoPCIe module 240. [

The FD management unit 231 of the remote file input / output processing module 230 has a function of accessing a file of the actual file system 210 through conversion or inverse transformation of a remote file descriptor and a local file descriptor internally generated in the file server 200 .

Hereinafter, a process of performing remote file input / output between a client and a file server will be described in detail with reference to FIG.

The file server 200 loads the remote file input / output API processing module 230 and the SoPCIe module 240 and generates a reception buffer 243 to wait for a link layer connection request and a file connection request of the client 100 S205).

The client 100 loads the remote file input / output API interpretation module 130 and the SoPCIe module 140 to generate a reception buffer 143 and performs link layer connection with the file server 200 at step S210.

When the file input / output application 110 of the client 100 calls the remote file input / output API 120 "Ropen ()" to open a remote file, the remote file input / output API interpreting module 130 And transmits the converted file descriptor to the file server 200 using the SoPCIe module 140, and waits for the resultant remote file descriptor (S215).

The remote file input / output API processing module 230 creates a file connection session according to the received file access request command, converts it into a file open API to perform an actual file open in the file system 210, To the remote file descriptor, and transmits the remote file descriptor to the client 100 (S220).

The client 100 returns the received result (remote file descriptor) to the file input / output application 110 (S225).

When the file input / output application 110 of the client 100 calls the "Rwrite ()" API via the opened remote file descriptor for storing the file data, the remote file input / output API interpretation module 130 converts it into a file write command , Converts the actual file data to be stored into transmission data, and transmits the transmission data to the file server 200 (S230).

The remote file input / output API processing module 230 of the file server 200 converts the remote file descriptor into the local file descriptor of the file server 20 using the FD management unit 231 to process the received file write command, Stores the received actual data through the file writing API, and returns the result to the client 100 (S235).

The client 100 returns the received file write result to the file input / output application 110 (S240).

When the file input / output application 110 of the client 100 calls the "Rread ()" API via the opened remote file descriptor for reading the file data, the remote file input / output API interpretation module 130 converts it into a file read command , Transfers it to the file server 200, and waits for read data (S245).

The remote file input / output API processing module 230 of the file server 200 converts the remote file descriptor into the local file descriptor of the file server 200 using the FD management unit 231 to process the received file read command, Reads the file of the file system 210 through the file reading API, and transmits the file to the client 100 (S250).

The client 100 returns the received file data to the file input / output application 110 (S255).

When the file input / output application 110 of the client 100 calls the API "Rclose ()" via the remote file descriptor opened for file access termination, the remote file input / output API interpretation module 130 converts , And transmits the request to the file server 200 to end the connection (S260).

The remote file input / output API processing module 230 of the file server 200 converts the remote file descriptor into the local file descriptor of the file server 200 using the FD manager 231 to process the received file access termination command , The file access of the file system 210 is terminated via the file access termination API, and the connection to the connection file descriptor is terminated (S265).

The embodiments of the present invention have been described above. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Therefore, the disclosed embodiments should be considered in an illustrative rather than a restrictive sense. The scope of the present invention is defined by the appended claims rather than by the foregoing description, and all differences within the scope of equivalents thereof should be construed as being included in the present invention.

100: Client
110: File I / O application
120: Remote File I / O API
130: remote file input / output API interpretation module
200: File server
210: File system
230: remote file input / output API processing module
231: FD manager
232: File I /
140, 240: SoPCIe module
141 and 241: a data transmission /
142, 242:
143, 243: Receive buffer
150, 250: PCIeLink device driver
160, 260: PCIeLink hardware

Claims (20)

A client converting the remote file input / output API and transfer factor called by the file input / output application into transmission data, converting it into a protocol for exclusive communication, and transmitting it according to the driving of the PCI Express network device; And
Output interface, converts the received remote file input / output command into an actual API and outputs the file to the file server
A remote file input / output using a dedicated communication module for a PCI Express network device in a HPC system including the remote file input / output system.
The method according to claim 1,
The client includes a remote file input / output API interpretation module for converting the remote file input / output API and the transfer factor, which are called, into transmission data for network transmission and delivering
A system that provides remote file I / O using a dedicated communication module for PCI Express network devices in an HPC system.
3. The method of claim 2,
The remote file input / output API interpretation module transmits either a remote file access command, a file write command, a file read command, or a file access end command according to a remote file input / output API called by the file input / output application
A system that provides remote file I / O using a dedicated communication module for PCI Express network devices in an HPC system.
The method according to claim 1,
The file server interprets the received remote file input / output command and converts it into the actual API corresponding to one of remote file access, file write, file read, and file access termination, and outputs the result of the actual file input / Including remote file input / output API processing module
A system that provides remote file I / O using a dedicated communication module for PCI Express network devices in an HPC system.
5. The method of claim 4,
The remote file input / output API processing module accesses the file system by performing a conversion or inverse conversion between a local file descriptor and a remote file descriptor
A system that provides remote file I / O using a dedicated communication module for PCI Express network devices in an HPC system.
6. The method of claim 5,
The remote file input / output API processing module creates a file connection session according to the received file access request command, converts the file connection API into a file open API to perform an actual file opening in the file system, and transmits the returned local file descriptor to the remote To a file descriptor and transferring the file descriptor to the client
A system that provides remote file I / O using a dedicated communication module for PCI Express network devices in an HPC system.
6. The method of claim 5,
The remote file input / output API processing module converts the remote file descriptor into a local file descriptor according to a received file write command, and stores the received actual data through a file writing API
A system that provides remote file I / O using a dedicated communication module for PCI Express network devices in an HPC system.
6. The method of claim 5,
The remote file input / output API processing module converts the remote file descriptor into the local file descriptor according to a received file read command, and reads the file of the file system through the file read API to transfer the data to the client
A system that provides remote file I / O using a dedicated communication module for PCI Express network devices in an HPC system.
6. The method of claim 5,
The remote file input / output API processing module converts the remote file descriptor into a local file descriptor according to a received file access termination command, ends file access of the file system through a file access termination API, Terminating the connection
A system that provides remote file I / O using a dedicated communication module for PCI Express network devices in an HPC system.
The method according to claim 1,
Each of the client and the server includes a SoPCIe module as a dedicated communication module, and the SoPCIe module converts the data transmitted from the upper module into a protocol for exclusive communication, thereby providing a PCIeLink device driver for driving the PCIeLink hardware as the PCI Express network device To deliver to
A system that provides remote file I / O using a dedicated communication module for PCI Express network devices in an HPC system.
11. The method of claim 10,
The SoPCIe module collects hardware information and virtual network address information about itself and a connection target from the PCI eLink device driver, and generates a connection for PCIe
A system that provides remote file I / O using a dedicated communication module for PCI Express network devices in an HPC system.
11. The method of claim 10,
The SoPCIe module generates a reception buffer for data transmission / reception using the remote memory sharing function provided by the PCIeLink hardware
A system that provides remote file I / O using a dedicated communication module for PCI Express network devices in an HPC system.
11. The method of claim 10,
The PCIeLink device driver converts and manages a remote memory between the client and the server using a remote memory sharing function and processes a connection command and a data transmission / reception command requested by the SoPCIe module
A system that provides remote file I / O using a dedicated communication module for PCI Express network devices in an HPC system.
(a) loading a SoPCIe module of a file server and a remote file input / output API processing module and generating a reception buffer;
(b) loading the client's SoPCIe module and the remote file input / output API interpretation module and creating a receive buffer;
(c) receiving a remote file input / output command including one of a remote file access command, a file write command, a file read command, and a file access termination command according to a remote file input / output API invoked in a file input / output application of the client; And
(d) analyzing the remote file input / output command and performing physical file input / output with the file system through the actual API to process remote file access, file write, file read and file access termination
Wherein the remote file input / output is provided using a dedicated communication module for a PCI Express network device in a HPC system including the remote file input / output device.
15. The method of claim 14,
The SoPCIe module of the file server and the client loaded in the steps (a) and (b) converts the data transmitted from the upper module into a protocol for exclusive communication and transmits the protocol to the PCIeLink device Passing to driver
A method for providing remote file input / output using a dedicated communication module for a PCI Express network device in an HPC system.
15. The method of claim 14,
The step (d) includes performing a conversion or inverse transformation between the local file descriptor and the remote file descriptor to access the file system
A method for providing remote file input / output using a dedicated communication module for a PCI Express network device in an HPC system.
17. The method of claim 16,
In step (d), a file connection session is created according to the received remote file access request command, the file connection session is converted into a file open API to perform an actual file opening of the file system, To a descriptor and transferring it to the client
A method for providing remote file input / output using a dedicated communication module for a PCI Express network device in an HPC system.
17. The method of claim 16,
The step (d) includes converting the remote file descriptor into a local file descriptor according to a received file write command, and storing the received actual data through a file writing API
A method for providing remote file input / output using a dedicated communication module for a PCI Express network device in an HPC system.
17. The method of claim 16,
The step (d) includes converting the remote file descriptor into a local file descriptor according to a received file write command, and storing the received actual data through a file writing API
A method for providing remote file input / output using a dedicated communication module for a PCI Express network device in an HPC system.
17. The method of claim 16,
In the step (d), the remote file descriptor is converted into a local file descriptor according to the received file access termination command, the file access of the file system is terminated through the file access termination API, and the connection to the remote file descriptor is terminated To end
A method for providing remote file input / output using a dedicated communication module for a PCI Express network device in an HPC system.
KR1020160077814A 2016-06-22 2016-06-22 System and method of providing remote file i/o using dedicated communication module for pci express network device on high performance computing system KR20180000096A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020160077814A KR20180000096A (en) 2016-06-22 2016-06-22 System and method of providing remote file i/o using dedicated communication module for pci express network device on high performance computing system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020160077814A KR20180000096A (en) 2016-06-22 2016-06-22 System and method of providing remote file i/o using dedicated communication module for pci express network device on high performance computing system

Publications (1)

Publication Number Publication Date
KR20180000096A true KR20180000096A (en) 2018-01-02

Family

ID=61004561

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020160077814A KR20180000096A (en) 2016-06-22 2016-06-22 System and method of providing remote file i/o using dedicated communication module for pci express network device on high performance computing system

Country Status (1)

Country Link
KR (1) KR20180000096A (en)

Similar Documents

Publication Publication Date Title
EP3748510A1 (en) Network interface for data transport in heterogeneous computing environments
US10152441B2 (en) Host bus access by add-on devices via a network interface controller
US10642777B2 (en) System and method for maximizing bandwidth of PCI express peer-to-peer (P2P) connection
US8949486B1 (en) Direct memory access to storage devices
EP3025241B1 (en) Scalable direct inter-node communication over peripheral component interconnect-express (pcie)
US5884313A (en) System and method for efficient remote disk I/O
WO2015078219A1 (en) Information caching method and apparatus, and communication device
EP2630579B1 (en) Unified i/o adapter
US10609125B2 (en) Method and system for transmitting communication data
US8370855B2 (en) Management of process-to-process intra-cluster communication requests
WO2015061971A1 (en) Data processing system and data processing method
US11940933B2 (en) Cross address-space bridging
JP2016529575A (en) Hard disk and data processing method
CN106844263B (en) Configurable multiprocessor-based computer system and implementation method
US9098354B2 (en) Management of application to I/O device communication requests between data processing systems
CN115374046B (en) Multiprocessor data interaction method, device, equipment and storage medium
CN112988647A (en) TileLink bus-to-AXI 4 bus conversion system and method
EP2515241B1 (en) Unified system area network and switch
US8521895B2 (en) Management of application to application communication requests between data processing systems
US8560594B2 (en) Management of process-to-process communication requests
KR20180000096A (en) System and method of providing remote file i/o using dedicated communication module for pci express network device on high performance computing system
Dalessandro et al. iSER storage target for object-based storage devices
US11487695B1 (en) Scalable peer to peer data routing for servers
US10042809B2 (en) Method for communication using PCI express dedicated communication module and network device including the same
CN218996035U (en) RDMA high-speed data transmission system matched with XMDA