CN107302473B - High-frequency data transmission pressure testing method and system - Google Patents
High-frequency data transmission pressure testing method and system Download PDFInfo
- Publication number
- CN107302473B CN107302473B CN201710469448.1A CN201710469448A CN107302473B CN 107302473 B CN107302473 B CN 107302473B CN 201710469448 A CN201710469448 A CN 201710469448A CN 107302473 B CN107302473 B CN 107302473B
- Authority
- CN
- China
- Prior art keywords
- numa node
- network adapter
- adapter port
- network
- local
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0805—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability
- H04L43/0811—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability by checking connectivity
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3409—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment
- G06F11/3414—Workload generation, e.g. scripts, playback
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0805—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability
- H04L43/0817—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability by checking functioning
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0876—Network utilisation, e.g. volume of load or congestion level
- H04L43/0894—Packet rate
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/14—Arrangements for monitoring or testing data switching networks using software, i.e. software packages
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/16—Threshold monitoring
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/50—Testing arrangements
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Environmental & Geological Engineering (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Computer Security & Cryptography (AREA)
- Computer And Data Communications (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention discloses a high-frequency data transmission pressure test method and a system, wherein the method comprises the following steps: the tested server allocates a first network adapter port corresponding to the local first NUMA node to a remote second NUMA node, and allocates a second network adapter port corresponding to the remote second NUMA node to the local first NUMA node; the press allocates a first network adapter port corresponding to the local first NUMA node, and allocates a second network adapter port corresponding to the remote second NUMA node; and the press machine runs a network testing tool to perform high-frequency data transmission pressure test on the tested server, wherein the network testing tool is universal network performance testing open source software. The invention verifies the high-frequency data transmission pressure by testing the data transmission state and performance of the network adapter, and reflects the stability of the high-speed transmission channel.
Description
Technical Field
The present invention relates to server testing technologies, and in particular, to a method and a system for testing high frequency data transmission pressure.
Background
In a big data era, a high-frequency data transmission channel is used as a server public system interface, and a channel for direct interconnection among chips can be realized, for example, a rapid interconnection channel among processors can realize direct interconnection inside a multi-core processor, so that the data transmission and processing efficiency is greatly accelerated. The rapid development of servers puts higher and higher requirements on high-frequency data transmission design, for example, the data transmission rate of super channel interconnection (UPI) (ultra Path interconnect) can reach 10.4GT/s, the bandwidth is more sufficient, the flexibility is stronger, and each message can send a plurality of requests. In this case, it is important to perform a pressure test for high-frequency data transmission. The existing testing method is a method for testing the error rate of a key node through which high-speed data transmission passes to verify whether the operation of a server system is stable, the method can complete the stability verification of the high-speed data transmission only by matching a plurality of testing tools, and the method does not consider a real service scene to carry out long-time pressure testing.
Disclosure of Invention
In order to solve the technical problem, the invention provides a high-frequency data transmission pressure testing method and a high-frequency data transmission pressure testing system, which reflect the stability of a high-speed transmission channel by verifying the high-frequency data transmission pressure.
In order to achieve the object of the present invention, the present invention provides a high frequency data transmission stress testing method, which is applied to a testing system formed by connecting a tested server and a pressure machine, where the tested server includes at least two non-uniform memory access NUMA nodes and at least two network adapters, each NUMA node corresponds to one network adapter, and the NUMA nodes communicate with each other through a QPI, including:
the tested server allocates a first network adapter port corresponding to the local first NUMA node to a remote second NUMA node, and allocates a second network adapter port corresponding to the remote second NUMA node to the local first NUMA node;
the press allocates a first network adapter port corresponding to the local first NUMA node, and allocates a second network adapter port corresponding to the remote second NUMA node;
and the press machine runs a network testing tool to perform high-frequency data transmission pressure test on the tested server, wherein the network testing tool is universal network performance testing open source software.
Further, before the server under test allocates the first network adapter port corresponding to the local first NUMA node to the remote second NUMA node and allocates the second network adapter port corresponding to the remote second NUMA node to the local first NUMA node, the method further includes:
the detected server sets the BIOS detection mode to an ES mode detected in advance.
Further, after the press runs a high-frequency data transmission pressure test on the server to be tested by the network test tool, the method further comprises the following steps:
the press collects performance results of the at least two network adapters, or states of the at least two network adapters, or system events;
the performance result comprises a network data transmission rate, and when the network data transmission rate is higher than a preset first threshold value, the pressure test is invalid; when the network data transmission rate is lower than a preset second threshold value, the pressure test is effective; when the state of the network adapter comprises hanging or error, indicating that the pressure test is invalid; and when the system event comprises a QPI channel error recorded in a system log or the system has no reaction for a long time, indicating that the stress test is invalid.
Further, the server under test allocates a first network adapter port corresponding to the local first NUMA node to the remote second NUMA node, and allocates a second network adapter port corresponding to the remote second NUMA node to the local first NUMA node, which specifically includes:
the server under test executes a first command line shell PowerShell script configured in advance, wherein the content of the first PowerShell script comprises:
acquiring hardware information and multi-queue RSS information of the first network adapter port and the second network adapter port, and determining the positions of a local first NUMA node and a remote second NUMA node;
and allocating a first network adapter port corresponding to the local first NUMA node to a remote second NUMA node, and allocating a second network adapter port corresponding to the remote second NUMA node to the local first NUMA node.
Further, the press allocates a first network adapter port corresponding to the local first NUMA node, and allocates a second network adapter port corresponding to the remote second NUMA node, which specifically includes
The press machine executes a second preconfigured PowerShell script, and the content of the second PowerShell script comprises the following steps:
acquiring hardware information and multi-queue RSS information of the first network adapter port and the second network adapter port, and determining the positions of a local first NUMA node and a remote second NUMA node;
and allocating a first network adapter port corresponding to the local first NUMA node, and allocating a second network adapter port corresponding to the remote second NUMA node.
Further, allocating, in the press, a first network adapter port corresponding to the local first NUMA node and allocating a second network adapter port corresponding to the remote second NUMA node includes:
the press executes a built-in command pre-configured in the installed network test tool, and the content of the built-in command comprises:
acquiring hardware information and multi-queue RSS information of the first network adapter port and the second network adapter port, and determining the positions of a local first NUMA node and a remote second NUMA node;
and allocating a first network adapter port corresponding to the local first NUMA node, and allocating a second network adapter port corresponding to the remote second NUMA node.
In order to achieve the object of the present invention, the present invention further provides a high frequency data transmission stress test system, which comprises:
the system comprises a tested server and a press which are connected with each other, wherein the tested server comprises at least two NUMA nodes and at least two network adapters, each NUMA node corresponds to one network adapter, the NUMA nodes communicate through a QPI (quick interconnect channel),
the tested server is used for allocating a first network adapter port corresponding to the local first NUMA node to a remote second NUMA node and allocating a second network adapter port corresponding to the remote second NUMA node to the local first NUMA node;
the press is used for allocating a first network adapter port corresponding to the local first NUMA node and allocating a second network adapter port corresponding to the remote second NUMA node;
the press machine is also used for operating a network testing tool to perform high-frequency data transmission pressure testing on the tested server, and the network testing tool is universal network performance testing open source software.
Further, before assigning a first network adapter port corresponding to the local first NUMA node to the remote second NUMA node, assigning a second network adapter port corresponding to the remote second NUMA node to the local first NUMA node,
the tested server is also used for setting the BIOS detection mode of the tested server to be the ES mode detected in advance.
Further, after the network test tool is operated to carry out high-frequency data transmission pressure test on the tested server,
the press collects performance results of the at least two network adapters, or states of the at least two network adapters, or system events;
the performance result comprises a network data transmission rate, and when the network data transmission rate is higher than a preset first threshold value, the pressure test is invalid; when the network data transmission rate is lower than a preset second threshold value, the pressure test is effective; when the state of the network adapter comprises hanging or error, indicating that the pressure test is invalid; and when the system event comprises a QPI channel error recorded in a system log or the system has no reaction for a long time, indicating that the stress test is invalid.
Further, the server under test is specifically configured to execute a first PowerShell script configured in advance in the server under test, where the first PowerShell script content includes:
acquiring hardware information and multi-queue RSS information of the first network adapter port and the second network adapter port, and determining the positions of a local first NUMA node and a remote second NUMA node;
and allocating a first network adapter port corresponding to the local first NUMA node to a remote second NUMA node, and allocating a second network adapter port corresponding to the remote second NUMA node to the local first NUMA node.
Further, the press machine is specifically configured to execute a preconfigured second PowerShell script in the press machine, where the second PowerShell script content includes:
acquiring hardware information and multi-queue RSS information of the first network adapter port and the second network adapter port, and determining the positions of a local first NUMA node and a remote second NUMA node;
and allocating a first network adapter port corresponding to the local first NUMA node, and allocating a second network adapter port corresponding to the remote second NUMA node.
Further, the press is specifically used for executing a built-in command pre-configured in a network test tool installed in the press, and the content of the built-in command includes:
acquiring hardware information and multi-queue RSS information of the first network adapter port and the second network adapter port, and determining the positions of a local first NUMA node and a remote second NUMA node;
and allocating a first network adapter port corresponding to the local first NUMA node, and allocating a second network adapter port corresponding to the remote second NUMA node.
The invention provides a method for testing high-frequency data transmission pressure, which is applied to a test system formed by connecting a tested server and a pressure machine, wherein the tested server comprises at least two non-uniform memory access (NUMA) nodes and at least two network adapters, each NUMA node corresponds to one network adapter, and the NUMA nodes are communicated through a QPI (quick interconnect channel) and comprise the following steps: the tested server allocates a first network adapter port corresponding to the local first NUMA node to a remote second NUMA node, and allocates a second network adapter port corresponding to the remote second NUMA node to the local first NUMA node; the press allocates a first network adapter port corresponding to the local first NUMA node, and allocates a second network adapter port corresponding to the remote second NUMA node; and the press machine runs a network testing tool to perform high-frequency data transmission pressure test on the tested server, wherein the network testing tool is universal network performance testing open source software. The stability of the high-speed transmission channel is reflected by verifying the high-frequency data transmission pressure.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
Drawings
The accompanying drawings are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the example serve to explain the principles of the invention and not to limit the invention.
FIG. 1 is a schematic flow chart of a high-frequency data transmission pressure testing method provided by the present invention;
FIG. 2 is a schematic structural diagram of a high-frequency data transmission pressure testing system according to the present invention;
fig. 3 is a schematic diagram of a high-frequency data transmission pressure testing method according to an embodiment of the present invention.
Detailed Description
The technical solution of the present invention will be described in more detail with reference to the accompanying drawings and examples.
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
In the following description, suffixes such as "module", "component", or "unit" used to denote elements are used only for facilitating the explanation of the present invention, and have no specific meaning in itself. Thus, "module", "component" or "unit" may be used mixedly.
Non-Uniform Memory Access (NUMA) is a design for multiple processors where the Memory Access time depends on the Memory location of the processor. Under NUMA, a processor accesses its own local memory more quickly than non-local memory (where memory goes to a processor or memory shared between another processor). In the NUMA technology (non-uniform memory access mechanism), all memories of a system are divided into a plurality of blocks, the system has a plurality of memory buses, and a processor is connected with one block of memory through each memory bus to form a group, so that the NUMA system is divided into a plurality of groups, and each group is called a node. The memory in this node is called local memory (local) and the memory in the other nodes is called remote memory (foreign memory) for this group. The multi-queue RSS (receive Side scaling) technique allows the network adapter to distribute the network processing load to multiple processor cores in a multi-core computer in kernel mode. In other words, RSS technology can enable network adapters to bind multiple processor cores, which can be local to a NUMA node or remote to a NUMA node. The distribution of this process can support higher network traffic loads than would be possible using only one core. The slot position of a mainboard high-speed peripheral component interconnect Express (PCI Express, which is a high-speed serial computer expansion bus standard) of the server network adapter determines the position of a local processor and the position of a local NUMA system.
The technical scheme provided by the invention is applied to a server based on a Windows system, wherein a Windows operating system can bind a network adapter to any processor core through PowerShell script, namely bind any NUMA node, can be bound to a local NUMA node or a remote NUMA node, each node has a processor and a memory with a plurality of cores, and the local node accesses the memory of other remote nodes through a quick interconnect channel QPI (QuickPath interconnect). The invention verifies whether the server can stably operate under the condition of high-frequency data transmission by testing the data transmission performance among the processors, between the memory and the processors and between the PCIE high-speed expansion equipment network adapters. Whether the high-frequency data transmission design is reasonable or not is verified by testing the data transmission state and performance of the network adapter, and whether the market business requirements can be met or not is verified.
Fig. 1 is a schematic flow chart of a high-frequency data transmission pressure test method provided by the present invention, and as shown in fig. 1, the present invention provides a high-frequency data transmission pressure test method, which is applied to a test system formed by connecting a tested server and a pressure machine, where the tested server includes at least 2 NUMA nodes and at least 2 network adapters, each NUMA node corresponds to one network adapter, and the NUMA nodes communicate with each other through a QPI, including:
the tested server allocates a first network adapter port corresponding to the local first NUMA node to a remote second NUMA node, and allocates a second network adapter port corresponding to the remote second NUMA node to the local first NUMA node;
the press allocates a first network adapter port corresponding to the local first NUMA node, and allocates a second network adapter port corresponding to the remote second NUMA node;
and the press machine runs a network testing tool to perform high-frequency data transmission pressure test on the tested server, wherein the network testing tool is universal network performance testing open source software.
The general network performance test open source software comprises one of the following: NTttcp (network Performance tool) test tool, NetCPS test tool, Jperf test tool, etc.
Further, the server under test allocates a first network adapter port corresponding to the local first NUMA node to the remote second NUMA node, and allocates a second network adapter port corresponding to the remote second NUMA node to the local first NUMA node, which specifically includes:
the tested server executes a first PowerShell script written in advance, and the content of the first PowerShell script comprises the following steps:
acquiring hardware information and multi-queue RSS information of the first network adapter port and the second network adapter port, and determining the positions of a local first NUMA node and a remote second NUMA node;
and allocating a first network adapter port corresponding to the local first NUMA node to a remote second NUMA node, and allocating a second network adapter port corresponding to the remote second NUMA node to the local first NUMA node.
Further, the press allocates a first network adapter port corresponding to the local first NUMA node, and allocates a second network adapter port corresponding to the remote second NUMA node, which specifically includes
Executing a second PowerShell script written in advance in the press machine, wherein the content of the second PowerShell script comprises:
acquiring hardware information and multi-queue RSS information of the first network adapter port and the second network adapter port, and determining the positions of a local first NUMA node and a remote second NUMA node;
and allocating a first network adapter port corresponding to the local first NUMA node, and allocating a second network adapter port corresponding to the remote second NUMA node.
Further, the press allocates a first network adapter port corresponding to the local first NUMA node, and allocates a second network adapter port corresponding to the remote second NUMA node, which specifically includes
The press executes built-in commands in the installed network test tool, and the contents of the built-in commands comprise:
acquiring hardware information and multi-queue RSS information of the first network adapter port and the second network adapter port, and determining the positions of a local first NUMA node and a remote second NUMA node;
and allocating a first network adapter port corresponding to the local first NUMA node, and allocating a second network adapter port corresponding to the remote second NUMA node.
Further, before the server under test allocates a first network adapter port corresponding to the local first NUMA node to the remote second NUMA node and allocates a second network adapter port corresponding to the remote second NUMA node to the local first NUMA node, the method further includes:
the detected server sets the BIOS detection mode to an ES mode detected in advance.
Further, after the press runs a high-frequency data transmission pressure test on the server to be tested by the network test tool, the method further comprises the following steps:
the press collects performance results of the at least two network adapters, or states of the at least two network adapters, or system events;
further, the performance result comprises a network data transmission rate, and when the network data transmission rate is higher than a preset first threshold value, the pressure test is invalid; when the network data transmission rate is lower than a preset second threshold value, the pressure test is effective; for example, the first threshold value may be set to 2400GB/S and the second threshold value may be set to 1900 GB/S.
Further, the state of the network adapter includes hang or error, which indicates that the test is invalid.
Further, the system event includes a QPI channel error recorded in a system log or no reflection of the system for a long time, which indicates that the test is invalid.
According to the high-frequency data transmission pressure test method provided by the invention, the pressure test of the high-frequency data transmission of the server is verified by using the network test tool, so that whether the design of a high-frequency data transmission channel of the server is reasonable or not can be effectively verified, and whether the stability meets the requirements of an actual service scene or not can be effectively verified. The method can be used for truly and effectively applying pressure to the high-frequency data transmission channel by combining with an actual service scene, and reflecting the running state of the system and the stability of the high-speed data transmission channel.
Fig. 2 is a schematic structural diagram of a high-frequency data transmission pressure testing system provided by the present invention, and as shown in fig. 2, the system includes:
the system comprises a tested server and a press which are connected with each other, wherein the tested server comprises at least 2 NUMA nodes and at least 2 network adapters, each NUMA node corresponds to one network adapter, the NUMA nodes communicate with each other through a QPI (quick interconnect channel),
the tested server is used for allocating a first network adapter port corresponding to the local first NUMA node to a remote second NUMA node and allocating a second network adapter port corresponding to the remote second NUMA node to the local first NUMA node;
the press is used for allocating a first network adapter port corresponding to the local first NUMA node and allocating a second network adapter port corresponding to the remote second NUMA node;
the press machine is also used for operating a network testing tool to perform high-frequency data transmission pressure testing on the tested server, and the network testing tool is universal network performance testing open source software.
The number of the press machines may be plural. The general network performance test open source software comprises one of the following: NTttcp (network Performance tool) test tool, NetCPS test tool, Jperf test tool, etc.
Further, the server under test is specifically configured to execute a first PowerShell script written in advance in the server under test, where the content of the first PowerShell script includes:
acquiring hardware information and multi-queue RSS information of the first network adapter port and the second network adapter port, and determining the positions of a local first NUMA node and a remote second NUMA node;
and allocating a first network adapter port corresponding to the local first NUMA node to a remote second NUMA node, and allocating a second network adapter port corresponding to the remote second NUMA node to the local first NUMA node.
Further, the press machine is specifically configured to execute a second PowerShell script written in advance in the press machine, where the second PowerShell script content includes:
acquiring hardware information and multi-queue RSS information of the first network adapter port and the second network adapter port, and determining the positions of a local first NUMA node and a remote second NUMA node;
and allocating a first network adapter port corresponding to the local first NUMA node, and allocating a second network adapter port corresponding to the remote second NUMA node.
Further, the press is particularly used for executing built-in commands in the installed network test tool in the press, and the contents of the built-in commands comprise:
acquiring hardware information and multi-queue RSS information of the first network adapter port and the second network adapter port, and determining the positions of a local first NUMA node and a remote second NUMA node;
and allocating a first network adapter port corresponding to the local first NUMA node, and allocating a second network adapter port corresponding to the remote second NUMA node.
Further, the server under test is further configured to set a BIOS detection mode of the basic input output system of the server under test to an early detection ES mode before allocating a first network adapter port corresponding to the local first NUMA node to the remote second NUMA node and allocating a second network adapter port corresponding to the remote second NUMA node to the local first NUMA node.
Further, the press is also used for carrying out high-frequency data transmission pressure test on the tested server by operating a network test tool,
the press is also used for collecting performance results of the at least two network adapters, or states of the at least two network adapters, or system events;
further, the performance result comprises a network data transmission rate, and when the network data transmission rate is higher than a preset first threshold value, the pressure test is invalid; when the network data transmission rate is lower than a preset second threshold value, the pressure test is effective; for example, the first threshold value may be set to 2400GB/S and the second threshold value may be set to 1900 GB/S.
Further, the state of the network adapter includes hang or error, which indicates that the test is invalid.
Further, the system event includes a QPI channel error recorded in a system log or no reflection of the system for a long time, which indicates that the test is invalid.
Example one
In this embodiment, the network testing tool takes ntttcp (network Performance tool) as an example to describe the technical solution of the present invention in detail.
Fig. 3 is a schematic diagram of a high-frequency data transmission pressure testing method according to an embodiment of the present invention, and as shown in fig. 3, the testing method specifically includes the following processes:
the method is carried out in a standard windows testing environment, and the testing environment comprises a tested server and a plurality of pressing machines. And (3) allocating the network adapter port of the local node of the tested server to a remote NUMA node by using a pre-written PowerShell script, namely allocating a port belonging to NUMA node 1 to NUMA node 2 and allocating a port belonging to NUMA node 2 to NUMA node 1. The press is installed with a network test tool, and in this embodiment, a network test tool, such as an NTTTCP tool, capable of binding a processor core to a specific network adapter port is adopted. And allocating the network adapter ports to the local NUMA nodes in the press through a network testing tool, namely allocating the ports belonging to NUMA node 1 and allocating the ports belonging to NUMA node 2. When the detection mode of the server under test is in the ES mode, the repeated crossing will result in a large number of QPI detection cycles, so as to apply pressure to the high frequency data transmission channel, as shown in fig. 3. Under such a large pressure, the throughput performance of the network adapter port will be greatly degraded, stuck, or zombie, and in this case, it is observed whether the system is operating normally or whether a system error occurs.
The method for testing the transmission pressure of the high-frequency data operated by the tested server mainly comprises the following steps:
(1) before pressure testing, setting a BIOS detection mode of a tested server to be an ES mode, and starting an NUMA architecture;
(2) all PCIE slot positions of server mainboard
(3) Before pressure testing, acquiring hardware information and RSS information of a port of a network adapter, and determining the position of a local NUMA node of the network adapter;
(4) renaming the port of the network adapter, wherein a principle is simplified, for example, 0-1,0 represents a PCIE slot position, and 1 represents the port number of the network adapter;
(5) the PowerShell script is used to allocate the network adapter port of the local node of the server under test to a remote NUMA node, for example, the script content may include the following content (the local NUMA node of the slot 0 location network card (network adapter 1) is 1, the remote NUMA node is 3, the local NUMA node of the slot 1 location network card (network adapter 2) is 2, and the remote NUMA node is 1):
(6) verifying the network connectivity of the tested server and the press;
(7) in a network test tool, distributing a network adapter port to a local NUMA node by using a built-in command parameter;
(8) operating a network test tool of the press;
(9) operating a network test tool of the tested server, and setting the test time to be 48 hours;
(10) and after the pressure test is finished, collecting the performance result of the network adapter, the state of the network adapter and a system event.
The invention verifies whether the high-frequency data transmission design is reasonable or not by testing the data transmission performance of the fast interconnection channel among the processors, the interconnection channel among the memory controllers and the network adapter of the PCIE high-speed expansion equipment. Allocating the network adapter port of the local node of the tested server to a remote NUMA node by using PowerShell script, namely forcibly allocating the network adapter port of the tested server to the remote NUMA node in a kernel space; and allocating the network adapter ports to the local NUMA nodes at the network test application layer, namely forcibly allocating the network adapter ports of the tested server to the local NUMA nodes in a user space. Such an arrangement will result in a high pressure condition for the high frequency data transmission channel.
In order to make the objects, technical solutions and advantages of the present invention more apparent, embodiments of the present invention will be described in detail below with reference to the accompanying drawings. It should be noted that the embodiments and features of the embodiments in the present application may be arbitrarily combined with each other without conflict.
The steps illustrated in the flow charts of the figures may be performed in a computer system such as a set of computer-executable instructions. Also, while a logical order is shown in the flow diagrams, in some cases, the steps shown or described may be performed in an order different than here.
Although the embodiments of the present invention have been described above, the above description is only for the convenience of understanding the present invention, and is not intended to limit the present invention. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims
Although the embodiments of the present invention have been described above, the above description is only for the convenience of understanding the present invention, and is not intended to limit the present invention. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (12)
1. A high-frequency data transmission pressure test method is applied to a test system formed by connecting a tested server and a pressure machine, and is characterized in that the tested server comprises at least two non-uniform memory access (NUMA) nodes and at least two network adapters, each NUMA node corresponds to one network adapter, and the NUMA nodes are communicated through a QPI (quick interconnect channel) and comprise the following steps:
the tested server allocates a first network adapter port corresponding to the local first NUMA node to a remote second NUMA node, and allocates a second network adapter port corresponding to the remote second NUMA node to the local first NUMA node;
the press allocates the first network adapter port corresponding to the local first NUMA node and allocates the second network adapter port corresponding to the remote second NUMA node;
and the press machine runs a network testing tool to perform high-frequency data transmission pressure test on the tested server, wherein the network testing tool is universal network performance testing open source software.
2. The method of claim 1, wherein before the server under test allocates a first network adapter port corresponding to the local first NUMA node to the remote second NUMA node and allocates a second network adapter port corresponding to the remote second NUMA node to the local first NUMA node, the method further comprises:
the detected server sets the BIOS detection mode to an ES mode detected in advance.
3. The method of claim 1, wherein after the press runs a network test tool to perform a high frequency data transmission stress test on the server under test, the method further comprises:
the press collects performance results of the at least two network adapters, or states of the at least two network adapters, or system events;
the performance result comprises a network data transmission rate, and when the network data transmission rate is higher than a preset first threshold value, the pressure test is invalid; when the network data transmission rate is lower than a preset second threshold value, the pressure test is effective; when the state of the network adapter comprises hanging or error, indicating that the pressure test is invalid; and when the system event comprises a QPI channel error recorded in a system log or the system has no reaction for a long time, indicating that the stress test is invalid.
4. The method of claim 1, wherein the server under test assigning a first network adapter port corresponding to the local first NUMA node to a remote second NUMA node and assigning a second network adapter port corresponding to the remote second NUMA node to the local first NUMA node comprises:
the server under test executes a first command line shell PowerShell script configured in advance, wherein the content of the first PowerShell script comprises:
acquiring hardware information and multi-queue RSS information of the first network adapter port and the second network adapter port, and determining the positions of a local first NUMA node and a remote second NUMA node;
and allocating a first network adapter port corresponding to the local first NUMA node to a remote second NUMA node, and allocating a second network adapter port corresponding to the remote second NUMA node to the local first NUMA node.
5. The method of claim 1, wherein the press assigns the first network adapter port corresponding to the local first NUMA node and the second network adapter port corresponding to the remote second NUMA node, in particular comprising
The press machine executes a second preconfigured PowerShell script, and the content of the second PowerShell script comprises the following steps:
acquiring hardware information and multi-queue RSS information of the first network adapter port and the second network adapter port, and determining the positions of a local first NUMA node and a remote second NUMA node;
and allocating the first network adapter port corresponding to the local first NUMA node, and allocating the second network adapter port corresponding to the remote second NUMA node.
6. The method of claim 1, wherein the press assigning the first network adapter port corresponding to the local first NUMA node and assigning the second network adapter port corresponding to the remote second NUMA node comprises:
the press executes a built-in command pre-configured in the installed network test tool, and the content of the built-in command comprises:
acquiring hardware information and multi-queue RSS information of the first network adapter port and the second network adapter port, and determining the positions of a local first NUMA node and a remote second NUMA node;
and allocating the first network adapter port corresponding to the local first NUMA node, and allocating the second network adapter port corresponding to the remote second NUMA node.
7. A high frequency data transmission stress testing system, the system comprising:
the system comprises a tested server and a press which are connected with each other, wherein the tested server comprises at least two NUMA nodes and at least two network adapters, each NUMA node corresponds to one network adapter, the NUMA nodes communicate through a QPI (quick interconnect channel),
the tested server is used for allocating a first network adapter port corresponding to the local first NUMA node to a remote second NUMA node and allocating a second network adapter port corresponding to the remote second NUMA node to the local first NUMA node;
the press is configured to allocate the first network adapter port corresponding to the local first NUMA node, and allocate the second network adapter port corresponding to the remote second NUMA node;
the press machine is also used for operating a network testing tool to perform high-frequency data transmission pressure testing on the tested server, and the network testing tool is universal network performance testing open source software.
8. The system of claim 7, wherein prior to assigning a first network adapter port corresponding to the local first NUMA node to the remote second NUMA node and assigning a second network adapter port corresponding to the remote second NUMA node to the local first NUMA node,
the tested server is also used for setting the BIOS detection mode of the tested server to be the ES mode detected in advance.
9. The system of claim 7, wherein after running a network test tool to perform a high frequency data transmission stress test on the server under test,
the press collects performance results of the at least two network adapters, or states of the at least two network adapters, or system events;
the performance result comprises a network data transmission rate, and when the network data transmission rate is higher than a preset first threshold value, the pressure test is invalid; when the network data transmission rate is lower than a preset second threshold value, the pressure test is effective; when the state of the network adapter comprises hanging or error, indicating that the pressure test is invalid; and when the system event comprises a QPI channel error recorded in a system log or the system has no reaction for a long time, indicating that the stress test is invalid.
10. The system of claim 7, wherein the server under test is specifically configured to execute a preconfigured first PowerShell script in the server under test, and the first PowerShell script content includes:
acquiring hardware information and multi-queue RSS information of the first network adapter port and the second network adapter port, and determining the positions of a local first NUMA node and a remote second NUMA node;
and allocating a first network adapter port corresponding to the local first NUMA node to a remote second NUMA node, and allocating a second network adapter port corresponding to the remote second NUMA node to the local first NUMA node.
11. The system of claim 7, wherein the press is specifically configured to execute a preconfigured second PowerShell script in the press, the second PowerShell script content comprising:
acquiring hardware information and multi-queue RSS information of the first network adapter port and the second network adapter port, and determining the positions of a local first NUMA node and a remote second NUMA node;
and allocating the first network adapter port corresponding to the local first NUMA node, and allocating the second network adapter port corresponding to the remote second NUMA node.
12. System according to claim 7, characterized in that said press, in particular for executing built-in commands pre-configured in a network test tool installed in said press, comprises:
acquiring hardware information and multi-queue RSS information of the first network adapter port and the second network adapter port, and determining the positions of a local first NUMA node and a remote second NUMA node;
and allocating the first network adapter port corresponding to the local first NUMA node, and allocating the second network adapter port corresponding to the remote second NUMA node.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710469448.1A CN107302473B (en) | 2017-06-20 | 2017-06-20 | High-frequency data transmission pressure testing method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710469448.1A CN107302473B (en) | 2017-06-20 | 2017-06-20 | High-frequency data transmission pressure testing method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107302473A CN107302473A (en) | 2017-10-27 |
| CN107302473B true CN107302473B (en) | 2020-01-10 |
Family
ID=60135429
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710469448.1A Active CN107302473B (en) | 2017-06-20 | 2017-06-20 | High-frequency data transmission pressure testing method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107302473B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113468009B (en) * | 2021-07-21 | 2024-05-24 | 宁畅信息产业(北京)有限公司 | Pressure testing method and device, electronic equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101354667A (en) * | 2007-07-24 | 2009-01-28 | 英业达股份有限公司 | Method for testing peripheral component interconnect bus level pressure |
| CN101833493A (en) * | 2010-03-24 | 2010-09-15 | 浪潮电子信息产业股份有限公司 | Method for testing stability and reliability of server based on linux system |
| CN104811353A (en) * | 2015-05-05 | 2015-07-29 | 浪潮电子信息产业股份有限公司 | Linux system based automatic network card performance test environment construction method |
| CN105243000A (en) * | 2015-10-30 | 2016-01-13 | 浪潮电子信息产业股份有限公司 | Cross-numa memory testing method suitable for multi-path server |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8539256B2 (en) * | 2009-02-10 | 2013-09-17 | International Business Machines Corporation | Optimizing power consumption and performance in a hybrid computer environment |
-
2017
- 2017-06-20 CN CN201710469448.1A patent/CN107302473B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101354667A (en) * | 2007-07-24 | 2009-01-28 | 英业达股份有限公司 | Method for testing peripheral component interconnect bus level pressure |
| CN101833493A (en) * | 2010-03-24 | 2010-09-15 | 浪潮电子信息产业股份有限公司 | Method for testing stability and reliability of server based on linux system |
| CN104811353A (en) * | 2015-05-05 | 2015-07-29 | 浪潮电子信息产业股份有限公司 | Linux system based automatic network card performance test environment construction method |
| CN105243000A (en) * | 2015-10-30 | 2016-01-13 | 浪潮电子信息产业股份有限公司 | Cross-numa memory testing method suitable for multi-path server |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107302473A (en) | 2017-10-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103052993B (en) | For full speed, the solution of parallel DUT test | |
| US8516487B2 (en) | Dynamic job relocation in a high performance computing system | |
| CN106095622A (en) | Data back up method and device | |
| CN113360422B (en) | Method and device for transmitting and receiving data by real-time operating system equipment in heterogeneous system | |
| US20120144146A1 (en) | Memory management using both full hardware compression and hardware-assisted software compression | |
| US10318343B2 (en) | Migration methods and apparatuses for migrating virtual machine including locally stored and shared data | |
| CN111008162A (en) | Method and system for realizing single PCIE slot supporting multiple PCIE ports | |
| WO2016101856A1 (en) | Data access method and apparatus | |
| CN109660391A (en) | A kind of pond server system firmware upgrade method, system and relevant apparatus | |
| CN111078353A (en) | Operation method of storage equipment and physical server | |
| CN107302473B (en) | High-frequency data transmission pressure testing method and system | |
| WO2022057439A1 (en) | Communication device for bare metal server and elastic block storage, intelligent network card, and system | |
| CN110191010B (en) | Pressure testing method of server | |
| US8688889B2 (en) | Virtual USB key for blade server | |
| CN107515725B (en) | Method and device for sharing disk by core network virtualization system and network management MANO system | |
| CN115827517A (en) | Control method and device and computing device | |
| CN1609819B (en) | Test method for computer external equipment interface | |
| CN112653598B (en) | Automatic testing method, device, equipment and readable storage medium | |
| CN115048255A (en) | Automatic test method, device, host and storage medium | |
| US20030131042A1 (en) | Apparatus and method of sharing a device between partitions of a logically partitioned computer system | |
| CN114090249A (en) | Resource allocation method, device, electronic equipment and storage medium | |
| US10824471B2 (en) | Bus allocation system | |
| CN108710508B (en) | Processing method and device and electronic equipment | |
| US9652429B2 (en) | Horizontally expandable computing system | |
| US20200341924A1 (en) | Processor/Endpoint Connection Configuration System |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20191204 Address after: 215100 No. 1 Guanpu Road, Guoxiang Street, Wuzhong Economic Development Zone, Suzhou City, Jiangsu Province Applicant after: Suzhou Wave Intelligent Technology Co., Ltd. Address before: 450018 Henan province Zheng Dong New District of Zhengzhou City Xinyi Road No. 278 16 floor room 1601 Applicant before: Zhengzhou Yunhai Information Technology Co. Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |