CN109039940B - Load balancing method and device for data transmission - Google Patents
Load balancing method and device for data transmission Download PDFInfo
- Publication number
- CN109039940B CN109039940B CN201810951533.6A CN201810951533A CN109039940B CN 109039940 B CN109039940 B CN 109039940B CN 201810951533 A CN201810951533 A CN 201810951533A CN 109039940 B CN109039940 B CN 109039940B
- Authority
- CN
- China
- Prior art keywords
- data
- node
- data transmission
- idle
- idle node
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
- H04L47/12—Avoiding congestion; Recovering from congestion
- H04L47/125—Avoiding congestion; Recovering from congestion by balancing the load, e.g. traffic engineering
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
- H04L47/24—Traffic characterised by specific attributes, e.g. priority or QoS
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention discloses a load balancing method and a device for data transmission, wherein the method at least comprises the following steps of receiving first data sent by a client, judging the data type of the first data, acquiring an idle node and formulating different data transmission strategies according to the data type of the first data, and transmitting the first data to the idle node through the different data transmission strategies.
Description
Technical Field
The present invention relates to the field of communications technologies, and in particular, to a data storage load balancing method and apparatus.
Background
Data transmission refers to the process of transferring data between a data source and a data sink over one or more links in accordance with an appropriate procedure. But also the operation of sending data from one place to another by means of signals on the channel.
The inventor of the invention finds that the following technical problems exist in the prior art in the research process: in the traditional data transmission technology, all data are treated indiscriminately in the transmission process, when data packets are transmitted, a large bandwidth is occupied due to long-time uploading of the data packets, if the data packets are transmitted in a load balancing mode, a large amount of bus transmission resources are occupied, and data blocking is easily caused.
Disclosure of Invention
Embodiments of the present invention provide a load balancing method and apparatus for data transmission, which can reduce the network blocking probability of a transmission data packet, thereby improving data transmission performance.
A first embodiment of the present invention provides a load balancing method for data transmission, which at least includes the following steps;
receiving first data sent by a client, and judging the data type of the first data;
acquiring an idle node and formulating different data transmission strategies according to the data type of the first data;
and transmitting the first data to the idle node through the different data transmission strategies.
Further, the data types include stream data and data packets.
Further, the acquiring an idle node and formulating different data transmission strategies according to the data type to which the first data belongs specifically includes:
when the data type of the first data is streaming data, judging whether the access quantity of each current transmission node is larger than a preset threshold value through an SDN network, taking each storage node with the access quantity smaller than the threshold value as an idle node, and making a data transmission strategy for concurrent response;
when the data type of the first data is a data packet, judging whether the access quantity of each current transmission node is larger than a preset threshold value through an SDN network, taking a storage node with the access quantity smaller than the threshold value and the minimum access quantity as an idle node, and formulating a data transmission strategy of an independent buffer area.
Further, the transmitting the first data to the idle node according to the different data transmission policies specifically includes:
and when the adopted data transmission strategy is the data transmission strategy of the concurrent response, sending the node information of the idle nodes to a load balancer through the SDN network, so that the load balancer sends the first data to each idle node in parallel according to the node information.
Further, the transmitting the first data to the idle node according to the different data transmission policies further includes:
when the adopted data transmission strategy is the data transmission strategy of the independent buffer area, a redirection request is sent to the client through the SDN network, so that the client is directly connected with the idle node, and the first data is sent to the idle node.
A second embodiment of the present invention correspondingly provides a load balancing apparatus for data transmission, including:
the data type judging module is used for receiving first data sent by a client and judging the data type of the first data;
the idle node acquisition module is used for acquiring idle nodes and formulating different data transmission strategies according to the data type of the first data;
and the data transmission module is used for transmitting the first data to the idle node through the different data transmission strategies.
Further, the data types include stream data and data packets.
Further, the acquiring an idle node and formulating different data transmission strategies according to the data type to which the first data belongs specifically includes:
when the data type of the first data is streaming data, judging whether the access quantity of each current transmission node is larger than a preset threshold value through an SDN network, taking each storage node with the access quantity smaller than the threshold value as an idle node, and making a data transmission strategy for concurrent response;
when the data type of the first data is a data packet, judging whether the access quantity of each current transmission node is larger than a preset threshold value through an SDN network, taking a storage node with the access quantity smaller than the threshold value and the minimum access quantity as an idle node, and formulating a data transmission strategy of an independent buffer area.
Further, the transmitting the first data to the idle node according to the different data transmission policies specifically includes:
and when the adopted data transmission strategy is the data transmission strategy of the concurrent response, sending the node information of the idle nodes to a load balancer through the SDN network, so that the load balancer sends the first data to each idle node in parallel according to the node information.
Further, the transmitting the first data to the idle node according to the different data transmission policies further includes:
when the adopted data transmission strategy is the data transmission strategy of the independent buffer area, a redirection request is sent to the client through the SDN network, so that the client is directly connected with the idle node, and the first data is directly sent to the idle node.
The embodiment of the invention has the following beneficial effects:
the embodiment of the invention provides a load balancing method and a device for data transmission, wherein the method comprises the following steps: receiving first data sent by a client, and judging the data type of the first data; acquiring an idle node and formulating different data transmission strategies according to the data type of the first data; and transmitting the first data to the idle node through the different data transmission strategies. Aiming at different data types, different transmission strategies are adopted for transmission, so that the network blocking probability of the transmission data packet is reduced, and the data transmission performance is improved.
Drawings
Fig. 1 is a flowchart illustrating a load balancing method for data transmission according to a first embodiment of the present invention;
fig. 2 is a schematic connection diagram of a load balancing apparatus for data transmission according to a second embodiment of the present invention;
description of the drawings, 101, a data type judgment module; 102. an idle node acquisition module; 103. and a data transmission module.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The first embodiment of the present invention:
as shown in fig. 1, a load balancing method for data transmission according to a first embodiment of the present invention at least includes the following steps:
s101, receiving first data sent by a client, and judging the data type of the first data;
s102, acquiring an idle node and making different data transmission strategies according to the data type of the first data;
s103, transmitting the first data to the idle node through the different data transmission strategies.
For step S101, specifically, the data types include stream data and data packets;
for step S102, according to the data type to which the first data belongs, acquiring an idle node and formulating different data transmission strategies, specifically:
when the data type of the first data is streaming data, judging whether the access quantity of each current transmission node is larger than a preset threshold value through an SDN network, taking each transmission node with the access quantity smaller than the threshold value as an idle node, and making a data transmission strategy for concurrent response; it should be noted that, because the streaming data has a high requirement on the instantaneity, a data transmission strategy of concurrent response is adopted, and the idle index of the storage node is captured in real time through a data flow sensing technology of the SDN, so as to provide an optimal path for a load balancing strategy and implement optimal instantaneity data streaming transmission processing.
When the data type of the first data is a data packet, judging whether the access quantity of each current transmission node is larger than a preset threshold value through an SDN network, taking a storage node with the access quantity smaller than the threshold value and the minimum access quantity as an idle node, and making a data transmission strategy of an independent buffer area; it should be noted that, because a large bandwidth is occupied by long-time uploading of a data packet, if the data packet is transmitted through load balancing, a large amount of bus transmission resources are occupied, and data blocking is easily caused, a data transmission strategy of an independent buffer is adopted.
For step S103, specifically, when the adopted data transmission policy is the data transmission policy of the concurrent response, the node information of the idle nodes is sent to the load balancer through the SDN network, so that the load balancer sends the first data to each idle node in parallel according to the node information.
When the adopted data transmission strategy is the data transmission strategy of the independent buffer area, a redirection request is sent to the client through the SDN so that the client is directly connected with the idle node, the first data is sent to the idle node, the idle storage node is judged through the data flow sensing technology of the SDN, the transmission request is redirected, the client is in butt joint with the idle storage node, point-to-point private line transmission is achieved, load balancing resources are not occupied, the network blocking probability of data packet transmission is reduced, and therefore data transmission performance is improved.
Second embodiment of the invention
On the basis of the first embodiment of the present invention, a second embodiment is provided.
Referring to fig. 2, a second embodiment of the present invention correspondingly provides a device for load balancing of data transmission, including:
the data type judging module is used for receiving first data sent by a client and judging the data type of the first data;
the idle node acquisition module is used for acquiring idle nodes and formulating different data transmission strategies according to the data type of the first data;
and the data transmission module is used for transmitting the first data to the idle node through the different data transmission strategies.
Specifically, the data types include stream data and data packets.
Further, the acquiring an idle node and formulating different data transmission strategies according to the data type to which the first data belongs specifically includes:
when the data type of the first data is streaming data, judging whether the access amount of each current transmission node is larger than a preset threshold value through an SDN network, taking each storage node with the access amount smaller than the threshold value as an idle node, and making a data transmission strategy of concurrent response.
When the data type of the first data is a data packet, judging whether the access amount of each current transmission node is larger than a preset threshold value through an SDN network, taking a storage node with the access amount smaller than the threshold value and the access amount being the minimum as an idle node, and formulating a data transmission strategy of an independent buffer area.
Further, the transmitting the first data to the idle node according to the different data transmission policies specifically includes:
and when the adopted data transmission strategy is the data transmission strategy of the concurrent response, sending the node information of the idle nodes to a load balancer through the SDN network, so that the load balancer sends the first data to each idle node in parallel according to the node information.
Further, the transmitting the first data to the idle node according to the different data transmission policies further includes:
when the adopted data transmission strategy is the data transmission strategy of the independent buffer area, a redirection request is sent to the client through the SDN so that the client is directly connected with the idle node, the first data is directly sent to the idle node, the idle storage node is judged through the data flow sensing technology of the SDN, the transmission request is redirected, the client is in butt joint with the idle storage node, point-to-point private line transmission is achieved, load balancing resources are not occupied, the network blocking probability of data packet transmission is reduced, and therefore data transmission performance is improved.
By implementing the embodiment of the invention, first data sent by a client is received, the data type of the first data is judged, if the first data is streaming data, whether the access volume of each current transmission node is greater than a preset threshold value or not is judged through an SDN network, each transmission node with the access volume less than the threshold value is taken as an idle node, a data transmission strategy for concurrent response is formulated, and the first data is transmitted to each idle node through a load balancer, so that the instantaneity of streaming data transmission is ensured; if the first data is a data packet, judging whether the access amount of each current transmission node is larger than a preset threshold value or not through an SDN (software defined network), taking a storage node with the access amount smaller than the threshold value and the access amount being the minimum as an idle node, making a data transmission strategy of an independent buffer area, sending a redirection request to the client through the SDN so as to enable the client to be directly connected with the idle node, sending the first data to the idle node so as not to occupy load balancing resources, reducing the network blocking probability of the transmission data packet, and improving the data transmission performance.
It should be noted that the above-described device embodiments are merely illustrative, wherein modules described as separate parts may or may not be physically separate, and parts displayed as modules may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. In addition, in the drawings of the embodiment of the apparatus provided by the present invention, the connection relationship between the modules indicates that there is a communication connection between them, and may be specifically implemented as one or more communication buses or signal lines. One of ordinary skill in the art can understand and implement it without inventive effort.
The foregoing is a preferred embodiment of the present invention, and it should be noted that it would be apparent to those skilled in the art that various modifications and enhancements can be made without departing from the principles of the invention, and such modifications and enhancements are also considered to be within the scope of the invention.
Claims (2)
1. A method for load balancing of data transmission, comprising at least the steps of:
receiving first data sent by a client, and judging a data type of the first data, wherein the data type comprises stream data and a data packet;
acquiring idle nodes and formulating different data transmission strategies according to the data type of the first data, wherein when the data type of the first data is streaming data, judging whether the access quantity of each current transmission node is greater than a preset threshold value through an SDN (software defined network), taking each storage node with the access quantity less than the threshold value as an idle node, and formulating a data transmission strategy for concurrent response;
when the data type of the first data is a data packet, judging whether the access quantity of each current transmission node is larger than a preset threshold value through an SDN network, taking a storage node with the access quantity smaller than the threshold value and the minimum access quantity as an idle node, and making a data transmission strategy of an independent buffer area;
transmitting the first data to the idle node through the different data transmission strategies;
when the adopted data transmission strategy is the data transmission strategy of the concurrent response, the SDN network sends the node information of the idle nodes to a load balancer, so that the load balancer sends the first data to each idle node in parallel according to the node information;
when the adopted data transmission strategy is the data transmission strategy of the independent buffer area, a redirection request is sent to the client through the SDN network, so that the client is directly connected with the idle node, and the first data is sent to the idle node.
2. An apparatus for load balancing of data transmissions, comprising:
the data type judging module is used for receiving first data sent by a client and judging the data type of the first data, wherein the data type comprises stream data and a data packet;
an idle node obtaining module, configured to obtain an idle node and formulate different data transmission policies according to a data type to which the first data belongs, where when the data type to which the first data belongs is streaming data, it is determined, through an SDN network, whether an access amount of each current transmission node is greater than a preset threshold, each storage node having an access amount smaller than the threshold is used as an idle node, and a data transmission policy for concurrent response is formulated;
when the data type of the first data is a data packet, judging whether the access quantity of each current transmission node is larger than a preset threshold value through an SDN network, taking a storage node with the access quantity smaller than the threshold value and the minimum access quantity as an idle node, and making a data transmission strategy of an independent buffer area;
a data transmission module, configured to transmit the first data to the idle node according to the different data transmission policies;
when the adopted data transmission strategy is the data transmission strategy of the concurrent response, the SDN network sends the node information of the idle nodes to a load balancer, so that the load balancer sends the first data to each idle node in parallel according to the node information;
when the adopted data transmission strategy is the data transmission strategy of the independent buffer area, a redirection request is sent to the client through the SDN network, so that the client is directly connected with the idle node, and the first data is directly sent to the idle node.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810951533.6A CN109039940B (en) | 2018-08-17 | 2018-08-17 | Load balancing method and device for data transmission |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810951533.6A CN109039940B (en) | 2018-08-17 | 2018-08-17 | Load balancing method and device for data transmission |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109039940A CN109039940A (en) | 2018-12-18 |
| CN109039940B true CN109039940B (en) | 2022-04-15 |
Family
ID=64626454
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810951533.6A Active CN109039940B (en) | 2018-08-17 | 2018-08-17 | Load balancing method and device for data transmission |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109039940B (en) |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2015061989A1 (en) * | 2013-10-30 | 2015-05-07 | 华为技术有限公司 | Method and device for data transmission |
| EP3069475A4 (en) * | 2013-11-12 | 2017-07-05 | Pivotal Software, Inc. | Streaming event data collection |
| CN106533967B (en) * | 2016-12-08 | 2019-04-12 | 北京中安智达科技有限公司 | A kind of data transmission method can customize load balancing |
-
2018
- 2018-08-17 CN CN201810951533.6A patent/CN109039940B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN109039940A (en) | 2018-12-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10313768B2 (en) | Data scheduling and switching method, apparatus, system | |
| US10594606B2 (en) | Wired data-connection aggregation | |
| US8908522B2 (en) | Transmission rate control | |
| EP3633937B1 (en) | Packet transmission method and network device | |
| RU2008101646A (en) | BACKGROUND JOINT USE OF NETWORK BANDWAY AFTER GATEWAY DEVICES | |
| WO2019179157A1 (en) | Data traffic processing method and related network device | |
| CN118200944A (en) | Collaborative communication | |
| CN102006242A (en) | Routing method of router and router | |
| US20200351215A1 (en) | Data Stream Sending Method and System, and Device | |
| CN111181873A (en) | Data transmission method, data transmission device, storage medium and electronic equipment | |
| CN117614517B (en) | Multilink data transmission method and device based on data transmission quantity control | |
| US10361837B2 (en) | Selective proxy to alleviate adjacent channel interference in full duplex cable network environments | |
| CN112787952B (en) | Service flow adjusting method and device | |
| RU2580395C2 (en) | System and method for realizing end-to-end hierarchical quality of service | |
| CN102594665B (en) | Service data transmission method and device | |
| CN102624769B (en) | Pipeline network device and related data transmission method | |
| CN113612698A (en) | Data packet sending method and device | |
| CN109039940B (en) | Load balancing method and device for data transmission | |
| US20160073173A1 (en) | Video stream providing method and system and relay apparatus | |
| WO2023116611A1 (en) | Queue control method and apparatus | |
| US5734675A (en) | Receiver sharing for demand priority access method repeaters | |
| CN205142245U (en) | A device that is arranged in intercepting multiple access network at carrier wave and carries out multicast communication | |
| CN114125931A (en) | Flow regulation method and device and network equipment | |
| CN115396383B (en) | Method for reversely controlling code stream in code stream transmitted by multiple devices | |
| US20130028255A1 (en) | Method, switching device and system for enabling multicast forwarding |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 510665 293 Zhongshan Avenue, Tianhe District, Guangzhou, Guangdong. Applicant after: GUANGDONG POLYTECHNIC NORMAL University Applicant after: Guangzhou Pingao Software Co., Ltd Address before: 510665 293 Zhongshan Avenue, Tianhe District, Guangzhou, Guangdong. Applicant before: GUANGDONG POLYTECHNIC NORMAL University Applicant before: Guangzhou Pingao Software Co., Ltd |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |