CN115622929B - Remote direct data access RDMA (remote direct memory Access) test method and related device - Google Patents
Remote direct data access RDMA (remote direct memory Access) test method and related device Download PDFInfo
- Publication number
- CN115622929B CN115622929B CN202211635942.8A CN202211635942A CN115622929B CN 115622929 B CN115622929 B CN 115622929B CN 202211635942 A CN202211635942 A CN 202211635942A CN 115622929 B CN115622929 B CN 115622929B
- Authority
- CN
- China
- Prior art keywords
- test
- data
- server
- strategy
- servers
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/50—Testing arrangements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0852—Delays
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0876—Network utilisation, e.g. volume of load or congestion level
- H04L43/0894—Packet rate
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Environmental & Geological Engineering (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The application provides a test method and a related device for remote direct data access RDMA, wherein the method comprises the following steps: the method comprises the steps that a single target testing strategy used for testing is determined according to testing instruction information and a testing strategy set, or a strategy combination consisting of a plurality of target testing strategies is selected, the testing strategy set comprises at least one of a pressure testing strategy, a complex service testing strategy and a complex networking testing strategy, if the determined single target testing strategy is the complex networking testing strategy, the complex networking testing strategy is sent to a first number of third servers to obtain at least one piece of first testing data including work tasks of different priority levels, and a first testing result is determined according to the at least one piece of first testing data, a first time point set receiving the first testing data and a first total bandwidth. In the embodiment of the application, different performances of RDMA can be tested according to the selected test strategy, and the convenience of detection is improved, so that the test efficiency is improved.
Description
Technical Field
The application belongs to the technical field of general data processing, and particularly relates to a remote direct data access RDMA testing method and a related device.
Background
Remote Direct Memory Access (RDMA), RDMA directly transfers data of a terminal to a memory area of another connected terminal through a network without any influence on an operating system and occupying more CPU resources. It eliminates the overhead of external memory area copy and context switch, thus freeing up memory bandwidth and CPU resources. Therefore, it is very important to clearly understand the performance of RDMA for subsequent use, and in the prior art, when the performance of RDMA is tested by using the existing testing tool, different testing environments need to be manually set up or deployed, which results in long testing time and fails to meet testing requirements.
Disclosure of Invention
The application provides a test method and a related device for remote direct data access RDMA (remote direct memory Access), which can select different test strategies according to test requirements, thereby realizing pressure test, complex service test and complex networking test on the RDMA, obtaining test results, improving the test convenience, avoiding manual repeated test, improving the test efficiency and enabling the test results to be more visual.
In a first aspect, the present application provides a remote direct data access RDMA testing method applied to a first server of a testing system, where the testing system includes the first server and at least one second server, and the first server and each of the at least one second server are connected via an RDMA network, where the method includes:
responding to received test instruction information, determining a single target test strategy for testing from a preset test strategy set, or selecting a strategy combination consisting of a plurality of target test strategies, wherein the test strategy set comprises at least one of a stress test strategy, a complex service test strategy and a complex networking test strategy;
if the single target test strategy determined according to the test instruction information is the complex networking test strategy, acquiring the total number of second servers in the at least one second server;
sending the complex networking test strategy to a first number of third servers, wherein the third servers are second servers in the at least one second server, the numerical value of the first number is a positive integer, and the numerical value of the first number is smaller than or equal to the numerical value of the total number;
receiving at least one first test data from the first number of third servers, determining a first time point set consisting of first time points at which each first test data is received, and a first total bandwidth when receiving the first test data, wherein the first test data is generated according to the complex networking test strategy, and the first test data comprises a plurality of work tasks with different priority levels, a first transmission bandwidth of the third servers, and a second time point when sending the first test data;
determining first latency information and first data reception efficiency information for the RDMA data transmissions according to the at least one first test data, the first set of time points, and the first total bandwidth;
and determining a first test result of the RDMA according to the first time delay information, the first data receiving efficiency information, the first preset time delay information and the first preset receiving efficiency.
In a second aspect, the present application provides an RDMA remote direct data access device, comprising:
the device comprises a first determining unit, a second determining unit and a third determining unit, wherein the first determining unit is used for responding to received test instruction information, determining a single target test strategy for testing from a preset test strategy set, or selecting a strategy combination consisting of a plurality of target test strategies, and the test strategy set comprises at least one of a pressure test strategy, a complex service test strategy and a complex networking test strategy;
a second determining unit, configured to, if the single target test policy determined according to the test instruction information is the complex networking test policy, obtain a total number of second servers in at least one second server, where the second server is a device connected to the device through an RDMA network;
a sending unit, configured to send the complex networking test policy to a first number of third servers, where the third servers are second servers in the at least one second server, a numerical value of the first number is a positive integer, and the numerical value of the first number is smaller than or equal to a numerical value of the total number;
a receiving unit, configured to receive at least one first test data from the first number of third servers, determine a first time point set formed by first time points at which each first test data is received, and determine a first total bandwidth when the first test data is received, where the first test data is data generated according to the complex networking test policy, and the first test data includes a plurality of work tasks with different priority levels, a first transmission bandwidth of the third server, and a second time point when the first test data is sent;
a third determining unit, configured to determine first latency information and first data reception efficiency information of the data transmission of RDMA according to the at least one first test data, the first set of time points, and the first total bandwidth;
a fourth determining unit, configured to determine a first test result of the RDMA according to the first delay information, the first data reception efficiency information, first preset delay information, and first preset reception efficiency.
In a third aspect, the present application provides an electronic device, comprising: one or more processors;
one or more memories for storing programs,
the one or more memories and the program are configured to control the electronic device, by the one or more processors, to execute the instructions of the steps in any of the methods of the first aspect of the embodiments of the present application.
In a fourth aspect, the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program for electronic data exchange, and wherein the computer program causes a computer to perform some or all of the steps as described in any one of the methods of the first aspect of the embodiments of the present application.
In a fifth aspect, the present application provides a computer program, wherein the computer program is operable to cause a computer to perform some or all of the steps as described in any of the methods of the first aspect of the embodiments of the present application. The computer program may be a software installation package.
The beneficial effects brought by the technical scheme provided by some embodiments of the application at least comprise:
in the embodiment of the application, the preset test strategy set comprises at least one of a pressure test strategy, a complex service test strategy and a complex networking test strategy, a single target test strategy for testing is determined from the test strategy set through the received test instruction information, or a strategy combination consisting of a plurality of target test strategies is selected, so that the convenience of testing can be improved, and different performance test requirements can be met. And if the single target test strategy is a complex networking test strategy, acquiring the total number of the second servers in at least one second server, and sending the complex networking test strategy to a first number of third servers to acquire at least one first test data from the first number of third servers, so as to determine a first test result according to the at least one first test data, a first time point set of time points for receiving the first test data, and a first total bandwidth, wherein the first test data comprises a plurality of work tasks with different priorities, and the at least one first test data is from the first number of third servers.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic structural diagram of a server provided in an embodiment of the present application;
FIG. 2 is a schematic diagram of a test system provided in an embodiment of the present application;
FIG. 3 is a flowchart of a method for testing RDMA (remote direct data Access), according to an embodiment of the present application;
fig. 4 is a block diagram illustrating functional units of a remote direct data access RDMA apparatus according to an embodiment of the present application.
Detailed Description
In order to make the technical solutions of the present application better understood, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application without making any creative effort belong to the protection scope of the present application.
The terms "first," "second," and the like in the description and claims of the present application and in the above-described drawings are used for distinguishing between different objects and not for describing a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.
Referring to fig. 1, fig. 1 is a schematic structural diagram of a server according to an embodiment of the present disclosure. As shown in fig. 1, the server includes one or more processors 120, a memory 130, a communication module 140, and one or more programs 131, and the processors 120 are communicatively connected to the memory 130 and the communication module 140 through an internal communication bus. It will be appreciated that the server is RDMA capable.
Wherein the one or more programs 131 are stored in the memory 130 and configured to be executed by the processor 120, the one or more programs 131 including instructions for performing any of the steps of the method embodiments described below.
The Processor 120 may be, for example, a Central Processing Unit (CPU), a general purpose Processor, a Digital Signal Processor (DSP), an Application-Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, a transistor logic device, a hardware component, or any combination thereof. Which may implement or perform the various illustrative logical blocks, units, and circuits described in connection with the present disclosure. The processor 120 may also be a combination of computing functions, e.g., comprising one or more microprocessors, DSPs and microprocessors, and the like. The communication unit may be the communication module 140, the transceiver, the transceiving circuit, etc., and the storage unit may be the memory 130.
The memory 130 may be either volatile memory or nonvolatile memory, or may include both volatile and nonvolatile memory. The non-volatile memory may be a read-only memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an Electrically Erasable PROM (EEPROM), or a flash memory. Volatile memory can be Random Access Memory (RAM), which acts as external cache memory. By way of example, and not limitation, many forms of Random Access Memory (RAM) are available, such as Static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous Link DRAM (SLDRAM), and direct bus RAM (DR RAM).
In order to better understand the technical solution of the embodiment of the present application, a test system that may be involved in the embodiment of the present application is first introduced.
Referring to fig. 2, fig. 2 is a schematic diagram of a test system according to an embodiment of the present disclosure. The test system comprises a first server and at least one second server. Wherein each second server of the at least one second server is network connected to the first server such that each second server can interact with the first server through the network.
It should be understood that, the first server and the second server shown in fig. 2 may each be installed with an application (i.e., an application client), and when the application client runs on each terminal device, data interaction may be performed with the first server shown in fig. 2.
Referring to fig. 3, fig. 3 is a flowchart illustrating a method for testing RDMA according to an embodiment of the present application. Hereinafter, a test method of remote direct data access RDMA according to an embodiment of the present application will be described in detail with reference to the accompanying drawings. As shown in fig. 3, a test method of remote direct data access RDMA is applied to a first server of a test system, the test system includes the first server and at least one second server, the first server and each second server of the at least one second server are connected through an RDMA network, the method includes the following steps:
The test strategy set comprises at least one of a stress test strategy, a complex service test strategy and a complex networking test strategy. Specifically, before the first server receives the test instruction information, the RDMA device to be tested is initialized, so that the accuracy of the test result is improved. And determining a single target test strategy for testing from the test strategy set according to the test instruction information, or selecting a strategy combination consisting of a plurality of target test strategies. For example, the plurality of target test strategies may be: the target test strategy of the combination of the pressure test strategy and the complex service test strategy, the combination of the complex service test strategy and the complex networking test strategy, and the combination of the complex service test strategy and the complex networking test strategy is not limited herein. Different test strategies are determined through the test instruction information, and the test convenience can be improved.
If the single target test strategy determined by the test instruction information is the complex networking test strategy, the total number of the second servers in at least one second server is obtained to determine the total number of the second servers which can be interacted, and data support is provided for subsequent complex networking test.
The third server is a second server in the at least one second server, the numerical value of the first number is a positive integer, and the numerical value of the first number is smaller than or equal to the numerical value of the total number. Specifically, a first number of third servers interacting with the first server is determined according to the total number, and after the determination, a complex networking test strategy is sent to the first number of third servers, so that the third servers generate first test data. It is to be understood that the first number may be a randomly generated number that is less than or equal to the total number, or the first number may be a number that is input according to the personal needs of the user, and the method of the first number is not limited herein.
The first test data are generated according to the complex networking test strategy, and comprise a plurality of work tasks with different priority levels, a first transmission bandwidth of the third server and a second time point when the first test data are sent. Specifically, the first server receives at least one first test data from a first number of third servers to simulate RDMA operations of one server receiving a plurality of servers, and the first test data includes work tasks of different priority levels, and different first test data may include work tasks of the same priority level or include work tasks of different priority levels, so as to improve the authenticity of the test and thus improve the reliability of the test result.
The first test data further includes a first transmission bandwidth of the third server and a second time point when the first test data is received, and the first time point set includes a first time point when each first test data in the at least one first test data is received. And finding a corresponding first time point from the first time point set according to the second time point, determining a single time delay according to the first time point and the second time point, and determining first time delay information according to each obtained time delay. And determining first data receiving efficiency information according to a first transmission bandwidth when each third server sends the first test data and a first total bandwidth of the first server.
The performance of the RDMA during the complex networking is determined through the first test result, for example, if the first delay information is smaller than first preset delay information, and the first data receiving efficiency information is larger than the first preset receiving efficiency, the performance of the RDMA during the complex networking is determined to be stable.
As can be seen, in this example, different RDMA performances are tested by determining different test policies, so as to improve the test efficiency. And the RDMA performance under the condition of complex networking can be tested, namely the processing performance of the RDMA when the work tasks of different priorities of different servers are received is tested. The test diversity is improved.
In a possible example, after receiving at least one first test data, the first server may obtain work tasks with different priority levels in each first test data, and execute the work tasks, obtaining an execution order. And determining whether the execution sequence is correct according to the priority corresponding to each work task, and further determining the RDMA performance under the condition of complex networking according to the judgment result.
In one possible example, receiving at least one first test data from the first number of third servers includes: determining a second number of fourth servers to be removed and a third number of fifth servers to be interacted according to the complex networking test strategy, the first number and the total number of the second servers, wherein the fourth servers are servers in the third servers with the first number, and the fifth servers are servers which do not receive the complex networking test strategy in the at least one second server; if the numerical value of the first quantity is larger than the numerical value of the second quantity, sending a test stopping message to a fourth server of the second quantity, wherein the test stopping message is used for prompting the fourth server receiving the test stopping message to stop sending the first test data; sending the complex networking test strategy to a third number of fifth servers; and receiving the first test data sent by a third server which does not receive the test stopping message in the first number of third servers and a third number of fifth servers.
In a specific example, the second number of fourth servers to be removed is determined according to the first number, for example, if the first number is 10, the determined value of the second number of fourth servers to be removed is between 0 and 10, and includes 0 and 10. Determining a third number of fifth servers to be interacted according to the first number and the total number of the second servers, that is, determining a value of the number of replaceable servers according to a difference between the first number and the total number, for example, if the value of the first number is 10, and the value of the total number is 22, determining the value of the number of replaceable servers as 12, and determining the value of the second number of the fifth servers as between 0 and 12, and including 0 and 12. After the third number of the fifth servers to be interacted is determined, a test stopping message is sent to the fourth servers of the second number, the test stopping message is used for prompting the fourth servers receiving the test stopping message to stop sending the first test data, and a complex networking test strategy is sent to the fifth servers of the third number, so that the first test data sent by the fifth servers are enabled to be sent. The first server receives first test data sent by a third server which does not receive the test stopping message in the first number of third servers and a third number of fifth servers to obtain a first test result.
Therefore, in the example, the server sending the first test data is switched, so that the test data are more comprehensive, and the accuracy and the reliability of the test result are improved.
In a possible example, the fifth server may be any one of the at least one second server, that is, after the third server disconnects the interaction with the first server, the fifth server may receive the complex networking test policy to interact with the first server again, so that the data obtained by the test is more comprehensive, and the accuracy of the test result is improved.
In a possible example, if the single target test policy determined according to the test instruction information is the complex service test policy, the method further includes: sending the complex business test policy to a target second server of the at least one second server; receiving a plurality of second test data from the target second server within a preset time length, wherein the second test data are created by the target second server according to the complex business test strategy, a single piece of second test data comprises a work task, and the types of a plurality of work tasks (WRs) corresponding to the plurality of second test data comprise at least two of a read type, a write type and a sending type; executing the plurality of work tasks to obtain an execution result; and determining a second test result of the RDMA according to the execution result.
In a specific example, if a single target test strategy determined according to the test instruction information is a complex service test strategy, the complex service test strategy is sent to a target second server in at least one second server, so that the target second server generates a plurality of second test data within a preset time, the second test data includes a work task, and the types of the work tasks in different second test data are randomly determined types, so that the plurality of work tasks corresponding to the plurality of second test data include at least two of a READ type, a WRITE type and a SEND type, thereby testing the performance of RDMA under the complex service condition. Specifically, the preset duration may be set according to actual requirements, and is not limited herein.
As can be seen, in this example, different types of work tasks may be generated, and a work task execution result may be obtained, so as to implement a performance test of RDMA under a complex service condition, that is, to test RDMA performance under a condition that a large number of different types of work tasks are received. Different performance tests are realized, the test convenience is improved, and the user experience is further improved.
In a possible example, the second server may generate different amounts of second test data in different time periods according to the complex service test policy, so as to obtain execution results of different amounts of executed work tasks and different types of work tasks, thereby improving accuracy of the test results.
In one possible example, if the single target test policy determined according to the test instruction information is the stress test policy, the method further includes: creating a plurality of first queue pairs according to the single target test strategy; if the number of the plurality of created first queue pairs reaches a preset number, repeatedly executing the following operation steps according to a preset execution number: deleting the last of the first queue pairs created; re-creating a second queue pair; acquiring process data in the execution process, wherein the process data comprises a deletion duration difference and a creation duration difference of the RDMA, the deletion duration difference is a difference between a value of a longest deletion duration and a value of a shortest deletion duration, the creation duration difference is a difference between a value of a longest creation duration and a value of a shortest creation duration, the deletion duration is a duration for deleting the first queue pair, and the creation duration is a duration for creating the second queue pair; judging whether the creating time length difference value is within a preset creating time length difference value range or not and whether the deleting time length difference value is within a preset deleting time length difference value range or not, and obtaining a judgment result; and determining a third test result of the RDMA according to the judgment result.
In a specific example, if the single target test policy determined according to the test instruction information is a stress test policy, a plurality of first Queue Pairs (QPs) are created until the number of created queue pairs reaches a preset number, specifically, the preset number is determined according to the RDMA specification. And if the number of the queue pairs reaches the preset number, deleting the first queue pair created last, and creating a second queue pair again, wherein the specifications of the first queue pair and the second queue pair can be the same. And repeating the steps of creating and deleting the last queue pair for multiple times to obtain a certain number of data samples, thereby improving the accuracy of the test result. When RDMA is fully loaded, the creation duration of the creation queue pair and the deletion duration of the deletion queue pair are obtained, and it can be understood that the number of repetitions may be randomly generated, or may be set according to actual requirements, and is not limited herein. Determining the longest creating time length and the shortest creating time length, and subtracting the value of the shortest creating time length from the value of the longest creating time length to obtain a creating time length difference value; and determining the longest deletion time length and the shortest deletion time length, and subtracting the value of the shortest deletion time length from the value of the longest deletion time length to obtain a deletion time length difference value. And judging whether the creating time length difference value is within a preset creating time length difference value range or not and whether the deleting time length difference value is within a preset deleting time length difference value range or not, and obtaining a judgment result. And determining a third RDMA test result according to the judgment result. For example, if the creation time difference is within a preset creation time difference range and the deletion time difference is within a preset deletion time difference range, it may be determined that the RDMA has strong data processing performance and good stability under the full load condition.
In this example, the steps of creating and deleting the last queue pair are repeated multiple times under the condition of full load of RDMA, so that the performance of RDMA under full load is tested, the efficiency of the test is improved, more data samples for determining the test result are obtained in the same time, and the accuracy of the test result is improved.
In a possible example, if the policy combination composed of the plurality of target test policies is determined according to the test instruction information, where the policy combination includes the complex service test policy and the complex networking test policy, the method further includes: sending the policy combination to the at least one second server; receiving a plurality of third test data from the at least one second server, and obtaining a third time point set composed of third time points at which each third test data is received, and a second total bandwidth when the third test data is received, where the third test data is data generated by a single second server in the at least one second server according to the policy combination, the third test data includes a plurality of work tasks with different priority levels, a second transmission bandwidth of the third server, and a fourth time point when the third test data is sent, and types of the plurality of work tasks of the plurality of third test data include at least two of a read type, a write type, and a send type; executing the plurality of third test data to obtain an execution result; determining second latency information and second data reception efficiency information for the RDMA data transmissions from the plurality of third test data, the third set of time points, and the second total bandwidth; and determining a fourth test result of the RDMA according to the execution result, the second delay information, the second data receiving efficiency information, second preset delay information and second preset receiving efficiency.
In a specific example, if the policy combination is determined to be a policy combination composed of a plurality of target test policies according to the test instruction information, and if the policy combination includes a complex service test policy and a complex networking test policy, the policy combination is sent to the at least one second server, a plurality of third test data from the at least one second server are received, and a second total bandwidth when the third test data is received is obtained at the same time, the third data includes a plurality of work tasks with different priority levels, and types of the plurality of work tasks of the plurality of third test data include at least two of a read type, a write type, and a send type, so that while testing the performance of RDMA processing different types of work tasks in the complex networking, the performance of RDMA processing different types of work tasks is detected. And after receiving the plurality of third test data, the first server executes the plurality of third test data to obtain an execution result. Determining and second time delay information according to a fourth time point and a third time point set in each third test data; and determining second data receiving efficiency information according to the second transmission bandwidth and the second total bandwidth in each third test data. And determining a fourth RDMA test result according to the execution result, the second time delay information, the second data receiving efficiency information, the second preset time delay information and the second preset receiving efficiency.
It can be seen that in this example, different performances of RDMA can be tested simultaneously, and the testing efficiency is improved.
In a possible example, if the policy combination composed of a plurality of target test policies is determined according to the test instruction information, if the policy combination includes a complex service test policy and a complex networking test policy, the complex service test policy may also be executed within a preset first duration, and the complex networking test policy may also be executed within a preset second duration, so as to obtain corresponding test results, simultaneously avoid manual multiple selection operations, and improve test efficiency.
In a possible example, if the policy combination composed of the multiple target test policies is determined according to the test instruction information, if the policy combination includes the pressure test policy and the complex networking test policy, the pressure test policy may be executed within a preset first duration, and the complex networking test policy may be executed within a preset second duration, so as to obtain corresponding test results, simultaneously avoid manual multiple selection operations, and improve the test efficiency.
In a possible example, if the policy combination composed of a plurality of target test policies is determined according to the test instruction information, and if the policy combination includes a pressure test policy, a complex service test policy, and a complex networking test policy, the pressure test policy may be executed within a preset first duration, the complex networking test policy may be executed within a preset second duration, and the pressure test policy may be executed within a preset third duration, so as to obtain corresponding test results, avoid multiple manual selection operations, and improve test efficiency.
In one possible example, the set of test policies further includes a queue pair length creation test policy, where the queue pair length creation test policy is used to instruct the first server to create a plurality of queue pairs in each of a preset plurality of creation durations, and a length of a single queue pair in the plurality of queue pairs is proportional to a value of a elapsed duration in a current creation duration, and destroy the created plurality of queue pairs after a queue pair with the longest length in the plurality of queue pairs reaches a preset length, so as to obtain a test result of creating queue pairs with different lengths for the RDMA.
In a specific example, the first server creates a plurality of queue pairs within a single creation time, the length of the single queue pair is proportional to a time length value spent within a current creation time, the created queue pairs are destroyed after the queue pair with the longest length in the queue pairs reaches a preset length, and the queue pairs are created again from the preset shortest queue pair to obtain a plurality of test sample data, so that the accuracy of the test result is improved.
In a possible example, the set of test policies further includes a queue pair state transition test policy, where the queue pair state transition test policy is used to instruct the first server to sequentially transition the created queue pair according to an initialization state, a ready-to-send state, a ready-to-receive state, and an error state, so as to obtain a test result corresponding to the state transition of the RDMA queue pair. Therefore, in the example, various performance tests are provided, and the test efficiency is improved, so that the use experience of the user is improved.
In a possible example, the set of test policies further includes a creation test policy of a queue pair, and if the single target test policy determined according to the test instruction information is the creation test policy of a queue pair, a Protection Domain (PD) is first created, then a Completion Queue (CQ) is created, and finally a Queue Pair (QP) is created. To determine the ability of RDMA to create queue pairs. Various performance tests are provided, and the testing efficiency is improved, so that the use experience of a user is improved.
In a possible example, the test policy set further includes a work task processing capability test policy, and if the single target test policy determined according to the test instruction information is the work task processing capability test policy, a preset number of Work Queues (WQ) are created for a queue pair created by the first server, the work queues are grouped into a linked list, the grouped linked list is transmitted to a send queue (send queue, SQ) of the queue pair, whether sending is successful is determined, and a first sending result is obtained. For example, 258 work queues are created, wherein the work queues alternately store the content of data segments with the length of 1, and the work queues are grouped into a linked list and transmitted into a sending queue. And creating a preset number of work queues, forming the work queues into a pointer array, transmitting the formed pointer array into a Receive Queue (RQ) of a queue pair, detecting whether the transmission is successful, and obtaining a second transmission result. For example, 258 work queues are created, wherein the work queues alternately store the contents of data segments with the length of 1 and 4, and the work queues are composed into pointer arrays and are transmitted into a receiving queue. And determining a test result according to the first sending result and the second sending result. The data samples obtained by the test are more comprehensive, and the accuracy of the test result is improved.
In the embodiment of the present application, functional modules of the remote direct data access RDMA apparatus may be divided according to the foregoing method example, for example, each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The division of the modules in the embodiment of the present application is schematic, and is only one logic function division, and there may be another division manner in actual implementation.
With reference to fig. 4, in a case that functional modules are divided according to respective functions, fig. 4 is a block diagram of functional units of a remote direct data access RDMA apparatus according to an embodiment of the present application, where the functional modules include:
a first determining unit 410, configured to determine, in response to received test instruction information, a single target test policy for testing from a preset test policy set, or select a policy combination composed of multiple target test policies, where the test policy set includes at least one of a stress test policy, a complex service test policy, and a complex networking test policy;
a second determining unit 420, configured to obtain a total number of second servers in at least one second server if the single target test policy determined according to the test instruction information is the complex networking test policy, where the second server is a device connected to the device through an RDMA network;
a sending unit 430, configured to send the complex networking test policy to a first number of third servers, where the third servers are second servers in the at least one second server, a numerical value of the first number is a positive integer, and the numerical value of the first number is smaller than or equal to a numerical value of the total number;
a receiving unit 440, configured to receive at least one first test data from the first number of third servers, determine a first time point set formed by first time points at which each first test data is received, and determine a first total bandwidth when the first test data is received, where the first test data is data generated according to the complex networking test policy, and the first test data includes a plurality of work tasks with different priority levels, a first transmission bandwidth of the third servers, and a second time point when the first test data is sent;
a third determining unit 450, configured to determine first latency information and first data reception efficiency information of the data transmission of the RDMA according to the at least one first test data, the first set of time points, and the first total bandwidth;
a fourth determining unit 460, configured to determine a first test result of the RDMA according to the first latency information, the first data reception efficiency information, the first preset latency information, and the first preset reception efficiency.
In a possible example, the receiving unit 440 is further configured to determine, according to the complex networking test policy, the first number, and the total number of the second servers, a second number of fourth servers to be removed, and a third number of fifth servers to be interacted, where the fourth servers are servers of the third servers of the first number, and the fifth servers are servers of the at least one second server that have not received the complex networking test policy; if the numerical value of the first quantity is larger than the numerical value of the second quantity, sending a test stopping message to a fourth server of the second quantity, wherein the test stopping message is used for prompting the fourth server receiving the test stopping message to stop sending the first test data; sending the complex networking test strategy to a third number of fifth servers; and receiving the first test data sent by a third server which does not receive the stop test message and a fifth server of the third number in the third number of servers.
In one possible example, the apparatus further comprises: sending the complex business test policy to a target second server of the at least one second server; receiving a plurality of second test data from the target second server within a preset time length, wherein the second test data are created by the target second server according to the complex service test strategy, a single second test data comprises a work task, and the types of a plurality of work tasks corresponding to the plurality of second test data comprise at least two of a read type, a write type and a sending type; executing the plurality of work tasks to obtain an execution result; and determining a second test result of the RDMA according to the execution result.
In one possible example, the apparatus further comprises: creating a plurality of first queue pairs according to the single target test strategy; and if the number of the plurality of created first queue pairs reaches a preset number, repeatedly executing the following operation steps according to a preset execution number: and deleting the last of the first queue pairs created; re-creating a second queue pair; and acquiring process data in the execution process, wherein the process data comprises a deletion duration difference and a creation duration difference of the RDMA, the deletion duration difference is a difference between a value of a longest deletion duration and a value of a shortest deletion duration, the creation duration difference is a difference between a value of the longest creation duration and a value of the shortest creation duration, the deletion duration is a duration for deleting the first queue pair, and the creation duration is a duration for creating the second queue pair; judging whether the creating time length difference value is within a preset creating time length difference value range or not and whether the deleting time length difference value is within a preset deleting time length difference value range or not, and obtaining a judgment result; and determining a third test result of the RDMA according to the judgment result.
In one possible example, the apparatus further comprises: sending the policy combination to the at least one second server; receiving a plurality of third test data from the at least one second server, and acquiring a third time point set composed of third time points at which each third test data is received, and a second total bandwidth when the third test data is received, where the third test data is data generated by a single second server in the at least one second server according to the policy combination, the third test data includes a plurality of work tasks with different priority levels, a second transmission bandwidth of the third server, and a fourth time point when the third test data is sent, and types of the plurality of work tasks of the plurality of third test data include at least two of a read type, a write type, and a send type; executing the plurality of third test data to obtain an execution result; determining second latency information and second data reception efficiency information for the RDMA data transmissions from the plurality of third test data, the third set of time points, and the second total bandwidth; and determining a fourth test result of the RDMA according to the execution result, the second delay information, the second data receiving efficiency information, second preset delay information and second preset receiving efficiency.
In a possible example, the set of test policies further includes a queue pair length creation test policy, where the queue pair length creation test policy is configured to instruct the first server to create a plurality of queue pairs within each of a preset plurality of creation durations, and a length of a single queue pair in the plurality of queue pairs is proportional to a value of a elapsed duration in a current creation duration, and destroy the created plurality of queue pairs after a queue pair with a longest length in the plurality of queue pairs reaches a preset length, so as to obtain a test result of creating queue pairs with different lengths for the RDMA.
In a possible example, the set of test policies further includes a queue pair state transition test policy, where the queue pair state transition test policy is used to instruct the first server to sequentially transition the created queue pair according to an initialization state, a ready-to-send state, a ready-to-receive state, and an error state, so as to obtain a test result corresponding to the state transition of the RDMA queue pair.
The above-described embodiments may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, the above-described embodiments may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions or computer programs. The procedures or functions described in accordance with the embodiments of the present application are produced in whole or in part when the computer instructions or the computer program are loaded or executed on a computer. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another computer readable storage medium, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wire or wirelessly. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains one or more collections of available media. The usable medium may be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium. The semiconductor medium may be a solid state disk.
Embodiments of the present application further provide a computer storage medium, where the computer storage medium stores a computer program for electronic data exchange, the computer program enables a computer to execute part or all of the steps of any one of the methods as described in the above method embodiments, and the computer includes an electronic device.
Embodiments of the present application also provide a computer program product, which includes a computer program operable to cause a computer to perform some or all of the steps of any one of the methods as set forth in the above method embodiments.
The computer program product may be a software installation package, the computer comprising an electronic device.
It should be understood that, in the various embodiments of the present application, the sequence numbers of the above-mentioned processes do not mean the execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present application.
In the several embodiments provided in the present application, it should be understood that the disclosed method, apparatus, and system may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative; for example, the division of the cell is only a logic function division, and there may be another division manner in actual implementation; for example, various elements or components may be combined or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may be separately and physically included, or two or more units may be integrated into one unit. The integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.
The integrated unit implemented in the form of a software functional unit may be stored in a computer readable storage medium. The software functional unit is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute some steps of the methods described in the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a portable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other media capable of storing program codes.
Although the present invention is disclosed above, the present invention is not limited thereto. Various changes and modifications can be easily made by those skilled in the art without departing from the spirit and scope of the present invention, and it is within the scope of the present invention to include different functions, combination of implementation steps, software and hardware implementations.
Claims (10)
1. A remote direct data Access (RDMA) test method applied to a first server of a test system including the first server and at least one second server, the first server and each of the at least one second server being connected via an RDMA network, the method comprising:
responding to received test instruction information, determining a single target test strategy for testing from a preset test strategy set, or selecting a strategy combination consisting of a plurality of target test strategies, wherein the test strategy set comprises at least one of a stress test strategy, a complex service test strategy and a complex networking test strategy;
if the single target test strategy determined according to the test instruction information is the complex networking test strategy, acquiring the total number of second servers in the at least one second server;
sending the complex networking test strategy to a first number of third servers, wherein the third servers are second servers in the at least one second server, the numerical value of the first number is a positive integer, and the numerical value of the first number is smaller than or equal to the numerical value of the total number;
receiving at least one first test data from the first number of third servers, determining a first time point set consisting of first time points at which each first test data is received, and a first total bandwidth when receiving the first test data, wherein the first test data is generated according to the complex networking test strategy, and the first test data comprises a plurality of work tasks with different priority levels, a first transmission bandwidth of the third servers, and a second time point when sending the first test data;
determining first latency information and first data reception efficiency information for the RDMA data transmissions in accordance with the at least one first test data, the first set of time points, and the first total bandwidth;
and determining a first test result of the RDMA according to the first time delay information, the first data receiving efficiency information, the first preset time delay information and the first preset receiving efficiency.
2. The method of claim 1, wherein receiving at least one first test data from the first number of third servers comprises:
determining a second number of fourth servers to be removed and a third number of fifth servers to be interacted according to the complex networking test strategy, the first number and the total number of the second servers, wherein the fourth servers are servers in the third servers with the first number, and the fifth servers are servers which do not receive the complex networking test strategy in the at least one second server;
if the numerical value of the first quantity is larger than the numerical value of the second quantity, sending a test stopping message to a fourth server of the second quantity, wherein the test stopping message is used for prompting the fourth server receiving the test stopping message to stop sending the first test data;
sending the complex networking test strategy to a third number of fifth servers;
and receiving the first test data sent by a third server which does not receive the test stopping message in the first number of third servers and a third number of fifth servers.
3. The method according to claim 1 or 2, wherein if the single target test policy determined according to the test instruction information is the complex traffic test policy, the method further comprises:
sending the complex business test policy to a target second server of the at least one second server;
receiving a plurality of second test data from the target second server within a preset time length, wherein the second test data are created by the target second server according to the complex service test strategy, a single second test data comprises a work task, and the types of a plurality of work tasks corresponding to the plurality of second test data comprise at least two of a read type, a write type and a sending type;
executing the plurality of work tasks to obtain an execution result;
and determining a second test result of the RDMA according to the execution result.
4. The method according to claim 1 or 2, wherein if the single target test strategy determined from the test instruction information is the stress test strategy, the method further comprises:
creating a plurality of first queue pairs according to the single target test strategy;
if the number of the plurality of created first queue pairs reaches a preset number, repeatedly executing the following operation steps according to a preset execution number:
deleting the last of the first queue pairs created;
re-creating a second queue pair;
acquiring process data in the execution process, wherein the process data comprises a deletion duration difference and a creation duration difference of the RDMA, the deletion duration difference is a difference between a value of a longest deletion duration and a value of a shortest deletion duration, the creation duration difference is a difference between the value of the longest creation duration and the value of the shortest creation duration, the deletion duration is a duration for deleting the first queue pair, and the creation duration is a duration for creating the second queue pair;
judging whether the creating time length difference is within a preset creating time length difference range or not and whether the deleting time length difference is within a preset deleting time length difference range or not, and obtaining a judgment result;
and determining a third test result of the RDMA according to the judgment result.
5. The method according to claim 1 or 2, wherein if the policy combination composed of the plurality of target test policies is determined according to the test instruction information, the policy combination includes the complex service test policy and the complex networking test policy, the method further includes;
sending the policy combination to the at least one second server;
receiving a plurality of third test data from the at least one second server, and obtaining a third time point set composed of third time points at which each third test data is received, and a second total bandwidth when the third test data is received, where the third test data is data generated by a single second server in the at least one second server according to the policy combination, the third test data includes a plurality of work tasks with different priority levels, a second transmission bandwidth of the third server, and a fourth time point when the third test data is sent, and types of the plurality of work tasks of the plurality of third test data include at least two of a read type, a write type, and a send type;
executing the third test data to obtain an execution result;
determining second latency information and second data reception efficiency information for the RDMA data transmissions from the plurality of third test data, the third set of time points, and the second total bandwidth;
and determining a fourth test result of the RDMA according to the execution result, the second delay information, the second data receiving efficiency information, second preset delay information and second preset receiving efficiency.
6. The method of claim 1 or 2, wherein the set of test policies further comprises a queue pair length creation test policy, the queue pair length creation test policy is configured to instruct the first server to create a plurality of queue pairs within each of a plurality of preset creation durations, and a length of a single queue pair in the plurality of queue pairs is proportional to a value of a duration that has elapsed within a current creation duration, and destroy the plurality of created queue pairs after a longest queue pair in the plurality of queue pairs reaches a preset length, so as to obtain the test result of RDMA for creating queue pairs of different lengths.
7. The method of claim 1 or 2, wherein the set of test policies further comprises a queue pair state transition test policy, and wherein the queue pair state transition test policy is configured to instruct the first server to sequentially transition the created queue pair according to an initialization state, a ready-to-send state, a ready-to-receive state, and an error state to obtain a test result corresponding to the state transition of the RDMA queue pair.
8. An apparatus for remote direct data access, RDMA, comprising:
the device comprises a first determining unit, a second determining unit and a third determining unit, wherein the first determining unit is used for responding to received test instruction information, determining a single target test strategy for testing from a preset test strategy set, or selecting a strategy combination consisting of a plurality of target test strategies, and the test strategy set comprises at least one of a pressure test strategy, a complex service test strategy and a complex networking test strategy;
a second determining unit, configured to, if the single target test policy determined according to the test instruction information is the complex networking test policy, obtain a total number of second servers in at least one second server, where the second server is a device connected to the device through an RDMA network;
a sending unit, configured to send the complex networking test policy to a first number of third servers, where the third servers are second servers of the at least one second server, a numerical value of the first number is a positive integer, and the numerical value of the first number is smaller than or equal to the numerical value of the total number;
a receiving unit, configured to receive at least one first test data from the first number of third servers, determine a first time point set formed by first time points at which each first test data is received, and determine a first total bandwidth when the first test data is received, where the first test data is data generated according to the complex networking test policy, and the first test data includes a plurality of work tasks with different priority levels, a first transmission bandwidth of the third server, and a second time point when the first test data is sent;
a third determining unit, configured to determine first latency information and first data reception efficiency information of the data transmission of RDMA according to the at least one first test data, the first set of time points, and the first total bandwidth;
a fourth determining unit, configured to determine a first test result of the RDMA according to the first delay information, the first data reception efficiency information, first preset delay information, and first preset reception efficiency.
9. An electronic device, comprising: a processor and a memory for storing computer program code comprising computer instructions which, if executed by the processor, the electronic device performs the method of any of claims 1 to 7.
10. A computer-readable storage medium, in which a computer program is stored, which computer program comprises program instructions which, if executed by a processor, cause the processor to carry out the method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211635942.8A CN115622929B (en) | 2022-12-20 | 2022-12-20 | Remote direct data access RDMA (remote direct memory Access) test method and related device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211635942.8A CN115622929B (en) | 2022-12-20 | 2022-12-20 | Remote direct data access RDMA (remote direct memory Access) test method and related device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115622929A CN115622929A (en) | 2023-01-17 |
| CN115622929B true CN115622929B (en) | 2023-03-07 |
Family
ID=84879660
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211635942.8A Active CN115622929B (en) | 2022-12-20 | 2022-12-20 | Remote direct data access RDMA (remote direct memory Access) test method and related device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115622929B (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114285778A (en) * | 2021-11-23 | 2022-04-05 | 南瑞集团有限公司 | Power dispatching data network networking safety test system and test method |
| CN115022328A (en) * | 2022-06-24 | 2022-09-06 | 脸萌有限公司 | Server cluster, server cluster testing method and device and electronic equipment |
| CN115037651A (en) * | 2022-06-24 | 2022-09-09 | 苏州浪潮智能科技有限公司 | RDMA bandwidth transmission testing method, system and storage medium |
| CN115174432A (en) * | 2022-06-30 | 2022-10-11 | 苏州浪潮智能科技有限公司 | RDMA (remote direct memory Access) network state monitoring method, device, equipment and readable storage medium |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7917597B1 (en) * | 2006-11-02 | 2011-03-29 | Netapp, Inc. | RDMA network configuration using performance analysis |
-
2022
- 2022-12-20 CN CN202211635942.8A patent/CN115622929B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114285778A (en) * | 2021-11-23 | 2022-04-05 | 南瑞集团有限公司 | Power dispatching data network networking safety test system and test method |
| CN115022328A (en) * | 2022-06-24 | 2022-09-06 | 脸萌有限公司 | Server cluster, server cluster testing method and device and electronic equipment |
| CN115037651A (en) * | 2022-06-24 | 2022-09-09 | 苏州浪潮智能科技有限公司 | RDMA bandwidth transmission testing method, system and storage medium |
| CN115174432A (en) * | 2022-06-30 | 2022-10-11 | 苏州浪潮智能科技有限公司 | RDMA (remote direct memory Access) network state monitoring method, device, equipment and readable storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 金浩 ; 杨洪章 ; .RDMA网络传输技术研究综述.2020,(18),全文. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115622929A (en) | 2023-01-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108173938A (en) | Server load shunt method and device | |
| CN108023829B (en) | Message processing method and device, storage medium and electronic equipment | |
| CN102340489B (en) | Data transmission method between servers and servers | |
| CN105630683B (en) | A kind of cloud testing architecture | |
| US10613992B2 (en) | Systems and methods for remote procedure call | |
| CN109710695B (en) | Transaction request validity identification and initiation method, device, equipment and medium | |
| CN114095567B (en) | Data access request processing method and device, computer equipment and medium | |
| CN111163130A (en) | Network service system and data transmission method thereof | |
| CN104317716B (en) | Data transmission method and distributed node equipment between distributed node | |
| CN111490947A (en) | Data packet transmitting method, data packet receiving method, system, device and medium | |
| CN105487937A (en) | RDMA (Remote Direct Memory Access) implementation method and device | |
| CN112422485B (en) | Communication method and device of transmission control protocol | |
| CN110061888B (en) | Network protocol type judgment method and device, computer equipment and storage medium | |
| CN112422328B (en) | Log acquisition method, device, computer equipment and storage medium | |
| CN115622929B (en) | Remote direct data access RDMA (remote direct memory Access) test method and related device | |
| CN107276998B (en) | OpenSSL-based performance optimization method and device | |
| CN108959020B (en) | Method and device for calculating CPU utilization rate of computer | |
| CN115934338A (en) | Inter-process communication method and device | |
| CN114338386B (en) | Network configuration method and device, electronic equipment and storage medium | |
| CN108062224B (en) | Data reading and writing method and device based on file handle and computing equipment | |
| CN102984138A (en) | Method, device and system for obtaining object | |
| US10742802B2 (en) | Methods and devices for verifying a communication number | |
| CN113051143A (en) | Detection method, device, equipment and storage medium for service load balancing server | |
| CN116233039B (en) | Message sending method, device, equipment and readable storage medium | |
| CN109614249B (en) | Method, device and computer readable storage medium for simulating multi-core communication |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |