CN116886641A - Data transmission method and device for network cluster - Google Patents
Data transmission method and device for network cluster Download PDFInfo
- Publication number
- CN116886641A CN116886641A CN202310970506.4A CN202310970506A CN116886641A CN 116886641 A CN116886641 A CN 116886641A CN 202310970506 A CN202310970506 A CN 202310970506A CN 116886641 A CN116886641 A CN 116886641A
- Authority
- CN
- China
- Prior art keywords
- node
- network
- data processing
- processed
- processing task
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 159
- 238000000034 method Methods 0.000 title claims abstract description 57
- 230000008569 process Effects 0.000 claims abstract description 15
- 238000004891 communication Methods 0.000 claims description 28
- 238000004590 computer program Methods 0.000 claims description 5
- 238000012163 sequencing technique Methods 0.000 claims description 3
- 230000000694 effects Effects 0.000 abstract description 5
- 238000010586 diagram Methods 0.000 description 6
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000737 periodic effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
- H04L47/36—Flow control; Congestion control by determining packet size, e.g. maximum transfer unit [MTU]
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The application provides a data transmission method and a device for a network cluster, wherein the method comprises the following steps: when a source node of a network cluster determines to issue a data processing task, determining a plurality of to-be-processed nodes corresponding to the data processing task from other nodes of the network cluster; determining a target node for executing the data processing task according to the network transmission information of each node to be processed; the network transmission information is used for describing the network transmission condition of each node to be processed; the data processing task is sent from the source node to the target node to cause the target node to process the data processing task. The application solves the technical problem of data loss caused by larger data stream transmission between two nodes in the prior art, and achieves the technical effects of improving the efficiency, stability and packet loss rate of network transmission.
Description
Technical Field
The present application relates to the field of data transmission technologies, and in particular, to a data transmission method and apparatus for a network cluster.
Background
In the prior art, when a node in an enterprise local area network issues a data processing task, a node in the local area network is randomly selected or a node with lower CPU load is selected to execute the task, if larger data stream transmission needs to be carried out between two nodes, data loss is easy to occur and the CPU load of the node is larger due to frequent data package and package unpacking, so that the network transmission efficiency and stability are affected.
Disclosure of Invention
Therefore, an object of the present application is to provide a data transmission method and apparatus for a network cluster, where when a source node needs to issue a data processing task to other nodes, a target node executing the data processing task is determined according to network transmission information of each node, and then the data processing task is sent to the target node, so that the target node processes the data processing task, which solves a technical problem of data loss caused by performing larger data stream transmission between two nodes in the prior art, and achieves a technical effect of improving efficiency, stability and packet loss rate of network transmission.
The application mainly comprises the following aspects:
in a first aspect, an embodiment of the present application provides a data transmission method for a network cluster, where the method includes: when a source node of a network cluster determines to issue a data processing task, determining a plurality of nodes to be processed corresponding to the data processing task from other nodes of the network cluster; determining a target node for executing the data processing task according to the network transmission information of each node to be processed; the network transmission information is used for describing the network transmission condition of each node to be processed; and sending the data processing task from the source node to the target node so that the target node processes the data processing task.
Optionally, the network transmission information includes a maximum transmission unit; the determining the target node for processing the data processing task according to the network transmission information of each node to be processed comprises the following steps: and determining a target node according to the maximum transmission unit of each node to be processed.
Optionally, after determining the target node according to the maximum transmission unit of each node to be processed, the method further includes: determining a communication maximum transmission unit for transmitting data to the target node last time by the source node and a packet loss rate generated when the target node receives the data; and when the packet loss rate is not zero, adjusting a communication maximum transmission unit for sending a data processing task to the target node by the source node according to the packet loss rate of the target node and the communication maximum transmission unit, so that the source node sends the data processing task to the target node according to the adjusted communication maximum transmission unit.
Optionally, the network transmission information includes a maximum transmission unit and a network status parameter; the determining the target node for processing the data processing task according to the network transmission information of each node to be processed comprises the following steps: determining at least one node to be selected according to the maximum transmission unit of each node to be processed; and determining a target node according to the network state parameters of each node to be selected.
Optionally, determining at least one node to be selected according to the maximum transmission unit of each node to be processed includes: sequencing the plurality of nodes to be processed according to the maximum transmission units of the plurality of nodes to be processed; and determining at least one node to be selected according to the ordered result.
Optionally, the network status parameters include: CPU load and network latency.
In a second aspect, an embodiment of the present application further provides a data transmission apparatus for a network cluster, where the apparatus includes: the first determining module is used for determining a plurality of to-be-processed nodes corresponding to the data processing task from other nodes of the network cluster when the source node of the network cluster determines to issue the data processing task; the second determining module is used for determining a target node for executing the data processing task according to the network transmission information of each node to be processed; the network transmission information is used for describing the network transmission condition of each node to be processed; and the sending module is used for sending the data processing task from the source node to the target node so as to enable the target node to process the data processing task.
Optionally, the network transmission information includes a maximum transmission unit; the second determining module is further configured to determine a target node according to a maximum transmission unit of each node to be processed.
In a third aspect, an embodiment of the present application further provides an electronic device, including: a processor, a memory and a bus, the memory storing machine readable instructions executable by the processor, the processor and the memory communicating via the bus when the electronic device is running, the machine readable instructions when executed by the processor performing the steps of the data transmission method for a network cluster as described in the first aspect or any possible implementation manner of the first aspect.
In a fourth aspect, the embodiment of the present application further provides a computer readable storage medium, on which a computer program is stored, which when executed by a processor performs the steps of the data transmission method for network clusters described in the first aspect or any possible implementation manner of the first aspect.
The embodiment of the application provides a data transmission method and device for a network cluster, wherein the method comprises the following steps: when a source node of a network cluster determines to issue a data processing task, determining a plurality of to-be-processed nodes corresponding to the data processing task from other nodes of the network cluster; determining a target node for executing the data processing task according to the network transmission information of each node to be processed; the network transmission information is used for describing the network transmission condition of each node to be processed; the data processing task is sent from the source node to the target node to cause the target node to process the data processing task. When a source node needs to issue data processing tasks to other nodes, a target node for executing the data processing tasks is determined according to network transmission information of each node, and then the data processing tasks are sent to the target node, so that the target node processes the data processing tasks, the technical problem of data loss caused by large data stream transmission between two nodes in the prior art is solved, and the technical effects of improving the efficiency, stability and packet loss rate of network transmission are achieved.
In order to make the above objects, features and advantages of the present application more comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the embodiments will be briefly described below, it being understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and other related drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 shows a flowchart of a data transmission method for a network cluster according to an embodiment of the present application.
Fig. 2 is a flowchart of another data transmission method for a network cluster according to an embodiment of the present application.
Fig. 3 is a functional block diagram of a data transmission device for a network cluster according to an embodiment of the present application.
Fig. 4 shows a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present application more apparent, the technical solutions of the embodiments of the present application will be clearly and completely described with reference to the accompanying drawings in the embodiments of the present application, and it should be understood that the drawings in the present application are for the purpose of illustration and description only and are not intended to limit the scope of the present application. In addition, it should be understood that the schematic drawings are not drawn to scale. A flowchart, as used in this disclosure, illustrates operations implemented according to some embodiments of the present application. It should be appreciated that the operations of the flow diagrams may be implemented out of order and that steps without logical context may be performed in reverse order or concurrently. Moreover, one or more other operations may be added to or removed from the flow diagrams by those skilled in the art under the direction of the present disclosure.
In addition, the described embodiments are only some, but not all, embodiments of the application. The components of the embodiments of the present application generally described and illustrated in the figures herein may be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the application, as presented in the figures, is not intended to limit the scope of the application, as claimed, but is merely representative of selected embodiments of the application. All other embodiments, which can be made by a person skilled in the art based on embodiments of the application without making any inventive effort, fall within the scope of the application.
In the prior art, the maximum transmission unit of each node in the network cluster is fixed, so that the utilization rate of data transmission is low, and the transmission efficiency is affected.
Based on this, the embodiment of the application provides a data transmission method and device for a network cluster, when a source node needs to issue data processing tasks to other nodes, according to network transmission information of each node, determining a target node for executing the data processing tasks, and then sending the data processing tasks to the target node, so that the target node processes the data processing tasks, the technical problem of data loss caused by large data stream transmission between two nodes in the prior art is solved, and the technical effects of improving the efficiency, stability and packet loss rate of network transmission are achieved, and the method and device concretely comprise the following steps:
referring to fig. 1, fig. 1 is a flowchart of a data transmission method for a network cluster according to an embodiment of the present application. As shown in fig. 1, the data transmission method for a network cluster provided by the embodiment of the application includes the following steps:
s101: when a source node of a network cluster determines to issue a data processing task, a plurality of nodes to be processed corresponding to the data processing task are determined from other nodes of the network cluster.
A network cluster refers to all nodes within a local area network, a node refers to a server or individual computer located within the local area network, each node being a separate entity. Other nodes refer to nodes in the network cluster other than the source node.
The data processing task is a task that the node needs to perform data processing, and may be calculation, inquiry, sorting, and the like.
The plurality of pending nodes refers to a plurality of nodes in the network cluster configured to perform data processing tasks.
That is, due to the large number of nodes in the network cluster, some nodes are configured to exclusively perform certain data processing tasks, and thus, it is necessary to determine which nodes can perform the data processing tasks before issuing the data processing tasks.
S102: and determining a target node for executing the data processing task according to the network transmission information of each node to be processed.
The network transmission information is used for describing the network transmission condition of each node to be processed. The network transmission information comprises a maximum transmission unit and network state parameters, wherein the network state parameters comprise CPU load and network delay.
The maximum transmission unit (MTU, maximum Transmission Unit) is used to inform the partner of the maximum size of the acceptable data service units, indicating the size of the payload that the sender can accept. CPU load refers to the number of processes (CPU, central Processing Unit, central processor) that use or wait to use one CPU core at a single point in time. The network delay (RTT) represents the total Time delay that has been experienced from the Time the sender sends data to the Time the sender receives a response from the receiver.
That is, the CPU load and the maximum transmission unit each describe the own situation of each node correspondingly, and the network delay describes the data transmission situation between each node to be processed and the source node. The larger the value of the maximum transmission unit MTU is, the more data quantity is allowed to be transmitted each time, the larger the CPU load is, the more data is processed by the node, and the longer the network delay is, the longer the time for the node to receive information is.
The determining the target node for processing the data processing task according to the network transmission information of each node to be processed comprises the following steps: and determining a target node according to the maximum transmission unit of each node to be processed.
Specifically, determining the target node according to the maximum transmission unit of each node to be processed includes: and selecting the node to be processed with the maximum MTU as a target node according to the maximum transmission unit of each node to be processed.
That is, the node with the largest transmission unit is selected as the target node as much as possible to receive the data processing task sent by the source node, so that the packet loss phenomenon is avoided when the target node receives the data processing task.
Referring to fig. 2, fig. 2 is a flowchart of another data transmission method for network clusters according to an embodiment of the present application. As shown in fig. 2, after determining the target node according to the maximum transmission unit of each node to be processed, the method further includes:
s201: determining a communication maximum transmission unit for transmitting data to the target node last time by the source node and a packet loss rate generated when the target node receives the data;
the maximum transmission unit of the communication that the target node last receives the data sent by the source node refers to the MTU of the communication protocol when the source node last sends the data to the target node, and the communication protocol refers to the transmission control protocol (TCP, transmission Control Protocol).
The packet loss rate generated when the destination node receives data refers to the ratio of the number of lost data packets to the data packets sent by the source node when the source node sends the data to the destination node last time.
That is, the packet loss rate generated when each node of the network cluster receives data sent by other nodes is monitored according to a preset cycle, so that after the target node is determined, the latest packet loss rate of the target node which is monitored periodically and receives the data sent by the source node is used as the packet loss rate of the last time the target node receives the data sent by the source node.
That is, before the source node sends the data processing task to the target node this time, the source node also sends the data to the target node, so that the packet loss rate generated by the latest monitored target node receiving the data sent by the source node can be obtained through periodic cycle monitoring, if the packet loss rate is 0, the data processing task is directly sent from the source node to the target node, without modifying the MTU of the communication protocol when the source node sends the data, and the data processing task is directly sent according to the MTU of the communication protocol when the source node sends the data to the target node last time. If the packet loss rate is not 0, the packet loss may occur in the target node because the MTU of the communication protocol when the source node sends the data is too large, so that the target node needs to unpack the data sent by the source node multiple times.
S202: and when the packet loss rate is not zero, adjusting a communication maximum transmission unit for sending a data processing task to the target node by the source node according to the packet loss rate of the target node and the communication maximum transmission unit, so that the source node sends the data processing task to the target node according to the adjusted communication maximum transmission unit.
Further, when the packet loss rate is determined to be not 0, calculating a difference value of the packet loss rate with the target node; and calculating the product of the difference value and the communication maximum transmission unit to be used as the adjusted communication maximum transmission unit. That is, a difference value of packet loss rate generated when the destination node receives the data from the source node last time is calculated; multiplying a communication maximum transmission unit of the source node for transmitting data to the target node last time by the difference value, wherein the obtained product is the modified communication maximum transmission unit of the source node for transmitting data to the target node, and then the source node transmits a data processing task to the target node according to the modified communication maximum transmission unit.
The determining the target node for processing the data processing task according to the network transmission information of each node to be processed comprises the following steps: determining at least one node to be selected according to the maximum transmission unit of each node to be processed; and determining a target node according to the network state parameters of each node to be selected.
The determining at least one node to be selected according to the maximum transmission unit of each node to be processed comprises: sequencing the plurality of nodes to be processed according to the maximum transmission units of the plurality of nodes to be processed; and determining at least one node to be selected according to the ordered result.
That is, the maximum transmission units of the plurality of nodes to be processed are arranged in a descending order, so as to obtain the plurality of arranged nodes to be processed, and at least one node to be selected can be determined according to a preset ordering. Namely, the first few nodes selected from the plurality of arranged nodes to be processed are used as at least one node to be selected.
Or, for each of the plurality of nodes to be processed, determining whether a maximum transmission unit of the node to be processed is greater than or equal to a preset MTU; if the maximum transmission unit of the node to be processed is greater than or equal to the preset MTU, the node to be processed is used as a node to be selected; and if the maximum transmission unit of the node to be processed is smaller than the preset MTU, the node to be processed is not used as the node to be selected.
The value of the preset MTU should be greater than or equal to the maximum transmission unit of the source node. Therefore, the maximum transmission unit of the node to be selected is ensured to be larger than or equal to the maximum transmission unit of the source node, and further, when the finally selected target node and the source node perform data transmission, a larger MTU can be used for data transmission, so that the data transmission efficiency is improved.
Specifically, determining the target node according to the network state parameter of each node to be selected includes: and selecting a target node from at least one node to be selected according to a preset rule.
The preset rule may be to select at least one first node having a CPU load smaller than a preset CPU load among the at least one node to be selected; selecting a second node with the smallest network delay from the at least one first node as a target node; or selecting at least one third node with network delay smaller than preset network delay from at least one node to be selected; and selecting a fourth node with the minimum CPU load from the at least one third node as a target node.
Further, a node having a smaller CPU load and network delay is selected as a target node as far as possible from among at least one node to be selected.
Alternatively, the preset rule may be to calculate a network state score for each node to be selected; and determining a target node according to the network state score of each node to be selected.
Calculating a network state score for each node to be selected, comprising: for each node to be selected, multiplying the CPU load of the node to be selected by a first preset value to obtain a first product, multiplying the network delay of the node to be selected by a second preset value to obtain a second product, and adding the first product and the second product to obtain the network state score of the node to be selected.
The first preset value and the second preset value can be set by themselves. If the first preset value and the second preset value are both set to be greater than 0, the network state score of the node to be selected is larger, which means that the CPU load and the network delay of the node to be selected are relatively larger. And if the first preset value and the second preset value are both set to be larger than 0, taking the node to be selected with the minimum network state score as a target node.
That is, as large as possible, the maximum transmission unit, the small CPU load, and the small network delay node among the at least one to-be-processed nodes serve as the target node, so that the possibility that the target node receives the information sent by the source node and generates packet loss is reduced.
Returning to fig. 1, S103: and sending the data processing task from the source node to the target node so that the target node processes the data processing task.
Further, after the destination node is determined, the data processing task is controlled to be transmitted from the source node to the destination node, so that the destination node processes the data processing task, and the communication maximum transmission unit when the data processing task is transmitted from the source node to the destination node may be transmitted according to the maximum transmission unit of the source node. After the target node performs the data processing task, the processing result may be sent to the source node, so that the source node determines the processing result.
That is, if the source node sends the data processing task to the other nodes, the other nodes with larger maximum transmission units are selected as the target nodes as far as possible, so that the target nodes are prevented from losing packets when receiving the data processing task sent by the source node.
The present application is directed to sending data processing tasks only, as to how the data processing tasks are executed in particular, without regard to the solution of the present application. The application is applied to a management system of a network cluster, and the management system can control the source node to send the data processing task to the target node after determining the target node of the data processing task issued by the source node, so that the target node executes the data processing task.
Based on the same application conception, the embodiment of the present application further provides a data transmission device for a network cluster, which corresponds to the data transmission method for a network cluster provided by the foregoing embodiment, and since the principle of solving the problem by the device in the embodiment of the present application is similar to that of the data transmission method for a network cluster provided by the foregoing embodiment of the present application, implementation of the device may refer to implementation of the method, and details of repetition are not repeated.
Fig. 3 is a functional block diagram of a data transmission device for a network cluster according to an embodiment of the present application. The data transmission device 10 for a network cluster comprises: a first determination module 101, a second determination module 102 and a transmission module 103.
The first determining module 101 is configured to determine, when a source node of a network cluster determines to issue a data processing task, a plurality of to-be-processed nodes corresponding to the data processing task from other nodes of the network cluster;
a second determining module 102, configured to determine a target node for executing the data processing task according to the network transmission information of each node to be processed; the network transmission information is used for describing the network transmission condition of each node to be processed;
and a sending module 103, configured to send the data processing task from the source node to the target node, so that the target node processes the data processing task.
The network transmission information comprises a maximum transmission unit; the second determining module is further configured to determine a target node according to a maximum transmission unit of each node to be processed.
Based on the same application concept, referring to fig. 4, a schematic structural diagram of an electronic device according to an embodiment of the present application is shown, where the electronic device 20 includes: a processor 201, a memory 202 and a bus 203, said memory 202 storing machine readable instructions executable by said processor 201, said processor 201 and said memory 202 communicating via said bus 203 when the electronic device 20 is running, said machine readable instructions being executed by said processor 201 to perform the steps of a data transmission method for a network cluster as described in any of the above embodiments.
In particular, the machine readable instructions, when executed by the processor 201, may perform the following: when a source node of a network cluster determines to issue a data processing task, determining a plurality of to-be-processed nodes corresponding to the data processing task from other nodes of the network cluster; determining a target node for executing the data processing task according to the network transmission information of each node to be processed; the network transmission information is used for describing the network transmission condition of each node to be processed; the data processing task is sent from the source node to the target node to cause the target node to process the data processing task.
Based on the same application concept, the embodiment of the present application further provides a computer readable storage medium, where a computer program is stored, and when the computer program is executed by a processor, the steps of the data transmission method for network clusters provided in the foregoing embodiment are executed.
Specifically, the storage medium may be a general storage medium, such as a mobile disk, a hard disk, or the like, and when a computer program on the storage medium is executed, the data transmission method for a network cluster described above may be executed, and when a source node needs to issue a data processing task to other nodes, the destination node that executes the data processing task is determined according to network transmission information of each node, and then the data processing task is sent to the destination node, so that the destination node processes the data processing task, thereby solving the technical problem of data loss caused when larger data stream transmission is performed between two nodes in the prior art, and achieving the technical effects of improving efficiency, stability and packet loss rate of network transmission.
It will be clear to those skilled in the art that, for convenience and brevity of description, specific working procedures of the above-described system and apparatus may refer to corresponding procedures in the foregoing method embodiments, which are not described herein again. In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other manners. The above-described apparatus embodiments are merely illustrative, for example, the division of the units is merely a logical function division, and there may be other manners of division in actual implementation, and for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be through some communication interface, device or unit indirect coupling or communication connection, which may be in electrical, mechanical or other form.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in the embodiments of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a non-volatile computer readable storage medium executable by a processor. Based on this understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
The foregoing is merely illustrative of the present application, and the present application is not limited thereto, and any person skilled in the art will readily appreciate variations or alternatives within the scope of the present application. Therefore, the protection scope of the application is subject to the protection scope of the claims.
Claims (10)
1. A data transmission method for a network cluster, the method comprising:
when a source node of a network cluster determines to issue a data processing task, determining a plurality of nodes to be processed corresponding to the data processing task from other nodes of the network cluster;
determining a target node for executing the data processing task according to the network transmission information of each node to be processed; the network transmission information is used for describing the network transmission condition of each node to be processed;
and sending the data processing task from the source node to the target node so that the target node processes the data processing task.
2. The method of claim 1, wherein the network transmission information comprises a maximum transmission unit;
the determining the target node for processing the data processing task according to the network transmission information of each node to be processed comprises the following steps:
and determining a target node according to the maximum transmission unit of each node to be processed.
3. The method of claim 2, wherein after determining the target node based on the maximum transmission unit of each node to be processed, the method further comprises:
determining a communication maximum transmission unit for transmitting data to the target node last time by the source node and a packet loss rate generated when the target node receives the data;
and when the packet loss rate is not zero, adjusting a communication maximum transmission unit for sending a data processing task to the target node by the source node according to the packet loss rate of the target node and the communication maximum transmission unit, so that the source node sends the data processing task to the target node according to the adjusted communication maximum transmission unit.
4. The method of claim 1, wherein the network transmission information includes a maximum transmission unit and a network status parameter;
the determining the target node for processing the data processing task according to the network transmission information of each node to be processed comprises the following steps:
determining at least one node to be selected according to the maximum transmission unit of each node to be processed;
and determining a target node according to the network state parameters of each node to be selected.
5. The method of claim 4, wherein the determining at least one node to be selected based on the maximum transmission unit of each node to be processed comprises:
sequencing the plurality of nodes to be processed according to the maximum transmission units of the plurality of nodes to be processed;
and determining at least one node to be selected according to the ordered result.
6. The method of claim 4, wherein the network status parameters comprise: CPU load and network latency.
7. A data transmission apparatus for a network cluster, the apparatus comprising:
the first determining module is used for determining a plurality of to-be-processed nodes corresponding to the data processing task from other nodes of the network cluster when the source node of the network cluster determines to issue the data processing task;
the second determining module is used for determining a target node for executing the data processing task according to the network transmission information of each node to be processed; the network transmission information is used for describing the network transmission condition of each node to be processed;
and the sending module is used for sending the data processing task from the source node to the target node so as to enable the target node to process the data processing task.
8. The apparatus of claim 7, wherein the network transmission information comprises a maximum transmission unit;
the second determining module is further configured to determine a target node according to a maximum transmission unit of each node to be processed.
9. An electronic device, comprising: a processor, a memory and a bus, the memory storing machine readable instructions executable by the processor, the processor and the memory in communication via the bus when the electronic device is running, the machine readable instructions when executed by the processor performing the steps of the data transmission method for a network cluster according to any one of claims 1 to 6.
10. A computer-readable storage medium, characterized in that the computer-readable storage medium has stored thereon a computer program which, when executed by a processor, performs the steps of the data transmission method for a network cluster according to any of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310970506.4A CN116886641A (en) | 2023-08-02 | 2023-08-02 | Data transmission method and device for network cluster |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310970506.4A CN116886641A (en) | 2023-08-02 | 2023-08-02 | Data transmission method and device for network cluster |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116886641A true CN116886641A (en) | 2023-10-13 |
Family
ID=88258608
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310970506.4A Pending CN116886641A (en) | 2023-08-02 | 2023-08-02 | Data transmission method and device for network cluster |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116886641A (en) |
-
2023
- 2023-08-02 CN CN202310970506.4A patent/CN116886641A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6224244B2 (en) | Power balancing to increase working density and improve energy efficiency | |
| CN109905259B (en) | Communication connection maintaining method, system and related equipment | |
| CN106095572B (en) | distributed scheduling system and method for big data processing | |
| CN110602156A (en) | Load balancing scheduling method and device | |
| US9853906B2 (en) | Network prioritization based on node-level attributes | |
| JP2010204876A (en) | Distributed system | |
| CN108933829A (en) | A kind of load-balancing method and device | |
| CN113810304A (en) | Load balancing method, device, equipment and computer storage medium | |
| CN110399329B (en) | RDMA data processing method and related device | |
| US10666723B2 (en) | Data distribution system, data communication device and program for data distribution | |
| CN111385328A (en) | Service request processing method and system and electronic equipment | |
| CN113268329A (en) | Request scheduling method, device and storage medium | |
| CN112612631A (en) | Message queue accumulation detection method and related device | |
| CN116886641A (en) | Data transmission method and device for network cluster | |
| JP2007179246A (en) | Method, program and server for computer management | |
| CN106102126B (en) | A kind of connection control method and device | |
| CN115941604A (en) | Flow distribution method, device, equipment, storage medium and program product | |
| JP5526748B2 (en) | Packet processing device, packet distribution device, control program, and packet distribution method | |
| JP4257857B2 (en) | Data processing system and data processing method | |
| JP6339978B2 (en) | Resource allocation management device and resource allocation management method | |
| CN110933122A (en) | Method, apparatus, and computer storage medium for managing server | |
| CN115037802B (en) | Request processing method and device, electronic equipment and storage medium | |
| CN117573603B (en) | Data processing method and computer equipment for remote direct memory access | |
| CN117032891A (en) | Virtual machine migration method, device, equipment and computer readable storage medium | |
| JP2004348233A (en) | File sharing system, server, and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |