CN110753004B - Dynamic current limiting method, system and device for data transmission and readable storage medium - Google Patents

Dynamic current limiting method, system and device for data transmission and readable storage medium Download PDF

Info

Publication number
CN110753004B
CN110753004B CN201910995272.2A CN201910995272A CN110753004B CN 110753004 B CN110753004 B CN 110753004B CN 201910995272 A CN201910995272 A CN 201910995272A CN 110753004 B CN110753004 B CN 110753004B
Authority
CN
China
Prior art keywords
bandwidth
rated
data
speed limiter
token
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910995272.2A
Other languages
Chinese (zh)
Other versions
CN110753004A (en
Inventor
海鑫
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Inspur Data Technology Co Ltd
Original Assignee
Beijing Inspur Data Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Inspur Data Technology Co Ltd filed Critical Beijing Inspur Data Technology Co Ltd
Priority to CN201910995272.2A priority Critical patent/CN110753004B/en
Publication of CN110753004A publication Critical patent/CN110753004A/en
Application granted granted Critical
Publication of CN110753004B publication Critical patent/CN110753004B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L47/00Traffic control in data switching networks
    • H04L47/10Flow control; Congestion control
    • H04L47/215Flow control; Congestion control using token-bucket
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L47/00Traffic control in data switching networks
    • H04L47/10Flow control; Congestion control
    • H04L47/20Traffic policing

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

The application discloses a data transmission dynamic current limiting method, a system, a device and a computer readable storage medium, comprising: setting a first rated bandwidth of a first speed limiter by using a rated processing bandwidth of a data receiving device; setting the maximum forwarding bandwidth of a first speed limiter by using the maximum processing bandwidth of data receiving equipment; utilizing a difference surplus bandwidth of a rated processing bandwidth and a current use bandwidth of the first speed limiter as a second rated bandwidth of the second speed limiter; according to the method and the device, the bandwidth upper limit of the first speed limiter is consistent with the data receiving equipment, the first class of data stream can be guaranteed to share the most bandwidth resources, the second rated bandwidth of the second speed limiter is the difference value between the rated processing bandwidth of the data receiving equipment and the current used bandwidth of the first speed limiter, the bandwidth which can be used by the second speed limiter is changed along with the condition that the first class of data stream uses the bandwidth, dynamic current limitation on the second class of data stream is achieved, and the priority transmission of the first class of data stream is guaranteed.

Description

Dynamic current limiting method, system and device for data transmission and readable storage medium
Technical Field
The present invention relates to the field of communication engineering, and in particular, to a dynamic current limiting method, system, device and computer readable storage medium for data transmission.
Background
In the process of network data transmission, the flow limitation needs to be carried out on the API interface layer, if the flow limitation is not considered, when concurrent data access with high persistence is met, the interface layer is jammed, if the concurrent data access is slow, the response is slow, if the concurrent data access is slow, the system is down, and the whole service system is broken down. This can cause huge economic losses and customer losses for the company. In the face of such a situation, the user request must be limited by a certain means to ensure the stability of the system and prevent the system from slowing down or down due to sudden increase of the flow.
Therefore, how to dynamically and efficiently limit data transmission in a network environment with variable traffic while fully utilizing the processing performance and data transmission capability of a server becomes a problem that needs to be considered in the development of a highly concurrent system.
Disclosure of Invention
In view of this, the present invention provides a method, a system, a device and a computer readable storage medium for dynamically and efficiently limiting current for data transmission. The specific scheme is as follows:
a dynamic current limiting method for data transmission comprises the following steps:
setting a first rated bandwidth of a first speed limiter aiming at the speed limit of the first type of data stream by using the rated processing bandwidth of the data receiving equipment;
setting the maximum forwarding bandwidth of the first speed limiter by using the maximum processing bandwidth of the data receiving equipment;
and utilizing a surplus bandwidth of the difference between the rated processing bandwidth and the current use bandwidth of the first speed limiter as a second rated bandwidth of a second speed limiter for limiting the speed of a second type of data stream, so that the second rated bandwidth of the second speed limiter is changed along with the current use bandwidth of the first speed limiter.
Optionally, the process of setting a first rated bandwidth of a first speed limiter for limiting the speed of the first type of data stream by using the rated processing bandwidth of the data receiving device includes:
and setting the token placing rate of the token bucket speed limiter aiming at the first class of data flow by utilizing the rated processing bandwidth of the data receiving equipment and the data volume corresponding to each token.
Optionally, the process of setting the maximum forwarding bandwidth of the first speed limiter by using the maximum processing bandwidth of the data receiving device includes:
and setting the token capacity of the token bucket speed limiter by using the maximum processing bandwidth of the data receiving equipment and the data volume corresponding to each token.
Optionally, the step of utilizing a surplus bandwidth of a difference between the rated processing bandwidth and a currently used bandwidth of the first speed limiter as a second rated bandwidth of a second speed limiter for limiting the speed of a second type of data stream includes:
and setting a token generation rate of the token speed limiter aiming at the second type data flow by utilizing a difference surplus bandwidth between the rated processing bandwidth and the current used bandwidth of the token bucket speed limiter and a data amount corresponding to each token.
The invention also discloses a data transmission dynamic current limiting system, which comprises:
the first rated bandwidth setting module is used for setting a first rated bandwidth of a first speed limiter aiming at the speed limit of the first type of data stream by using the rated processing bandwidth of the data receiving equipment;
the maximum bandwidth setting module is used for setting the maximum forwarding bandwidth of the first speed limiter by using the maximum processing bandwidth of the data receiving equipment;
and the second rated bandwidth setting module is used for utilizing the surplus bandwidth of the difference value between the rated processing bandwidth and the current used bandwidth of the first speed limiter as the second rated bandwidth of a second speed limiter aiming at the second type of data flow speed limit, so that the second rated bandwidth of the second speed limiter is changed along with the current used bandwidth of the first speed limiter.
Optionally, the first rated bandwidth setting module is specifically configured to set a token placement rate of the token bucket speed limiter for the first type of data flow by using a rated processing bandwidth of a data receiving device and a data amount corresponding to each token.
Optionally, the maximum bandwidth setting module is specifically configured to set a token capacity of the token bucket speed limiter by using the maximum processing bandwidth of the data receiving device and a data amount corresponding to each token.
Optionally, the second rated bandwidth setting module is specifically configured to set a token generation rate of the token rate limiter for the second type of data stream by using a difference surplus bandwidth between the rated processing bandwidth and a current used bandwidth of the token bucket rate limiter and a data amount corresponding to each token.
The invention also discloses a data transmission dynamic current limiting device, which comprises:
a memory for storing a computer program;
a processor for executing the computer program to implement the data transmission dynamic current limiting method as described above.
The invention also discloses a computer readable storage medium, on which a computer program is stored, which when executed by a processor implements the data transmission dynamic current limiting method as described above.
In the invention, the dynamic current limiting method for data transmission comprises the following steps: setting a first rated bandwidth of a first speed limiter aiming at the speed limit of the first type of data stream by using the rated processing bandwidth of the data receiving equipment; setting the maximum forwarding bandwidth of a first speed limiter by using the maximum processing bandwidth of data receiving equipment; and utilizing the surplus bandwidth of the difference value between the rated processing bandwidth and the current use bandwidth of the first speed limiter as a second rated bandwidth of a second speed limiter for limiting the speed of the second type of data stream, so that the second rated bandwidth of the second speed limiter is changed along with the current use bandwidth of the first speed limiter.
The invention sets a first rated bandwidth for a first speed limiter which limits the speed of a first type of data stream by using the rated processing bandwidth of data receiving equipment, sets the maximum forwarding bandwidth of the first speed limiter by using the maximum processing bandwidth of the data receiving equipment, ensures that the upper limit of the bandwidth of the first speed limiter is consistent with the data receiving equipment, ensures that the first type of data stream can share the most bandwidth resources, simultaneously sets the maximum forwarding bandwidth to ensure that the first speed limiter has the capacity of bearing the instantaneous overload of the first type of data stream, and sets a second rated bandwidth of a second speed limiter which limits the speed of a second type of data stream to be the difference value of the rated processing bandwidth of the data receiving equipment and the current using bandwidth of the first speed limiter, so that the available bandwidth of the second speed limiter is changed along with the condition of the using bandwidth of the first type of data stream, thereby realizing the dynamic current limiting of the second type of data stream and ensuring the preferential transmission of the first type of data stream.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a schematic flow chart of a dynamic current limiting method for data transmission according to an embodiment of the present invention;
fig. 2 is a schematic flow chart illustrating another dynamic current limiting method for data transmission according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of a dynamic current limiting system for data transmission according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The embodiment of the invention discloses a dynamic current limiting method for data transmission, which comprises the following steps of:
s11: a first rated bandwidth of a first rate limiter limiting speed for a first type of data stream is set using a rated processing bandwidth of a data receiving device.
Specifically, the first type of data stream may be used as main data to be received by the data receiving device, the priority of the first type of data stream is higher than that of the second type of data stream, in order to ensure that the first type of data stream can be transmitted to the data receiving device as fast as possible, the first rated bandwidth of the first speed limiter that limits the transmission rate for the first type of data stream is set to the maximum value as far as possible, and the first rated bandwidth of the first speed limiter may be set to be equal to the rated processing bandwidth of the data receiving device according to the rated processing bandwidth of the data receiving device, so that the first rated bandwidth of the first speed limiter reaches the maximum value, and the first type of data stream can be ensured to rapidly and effectively enter the data receiving device.
The data receiving device may be a server, a client, a network switch, or other communication device, the first type of data stream may be a data stream of a core service, and the second type of data stream may be a data stream of a non-core service, and of course, the first type of data stream and the second type of data stream may also correspond to a multi-level and a level data stream, and are not limited to two types of data streams, which both satisfy the spirit of the embodiments of the present invention.
S12: and setting the maximum forwarding bandwidth of the first speed limiter by using the maximum processing bandwidth of the data receiving equipment.
Specifically, in order to cope with the situation that the bursty data flow is instantaneously overloaded, the first speed limiter further has a maximum forwarding bandwidth on the basis of the first rated bandwidth, when the first type of data flow exceeds the first rated bandwidth of the first speed limiter in a unit time, and in order to ensure that the first type of data flow can still reach the data receiving device through the first speed limiter in such a situation, the maximum forwarding bandwidth of the first speed limiter may be set to be equal to the maximum processing bandwidth of the data receiving device, the maximum processing bandwidth of the data receiving device is greater than the rated processing bandwidth of the data receiving device, and the data receiving device and the first speed limiter can cope with the situation that the first type of data flow exceeds the first rated bandwidth in a certain time, for example, the first type of data flow exceeding the first rated bandwidth and being less than or equal to the maximum processing bandwidth can be borne within one second.
S13: and utilizing the surplus bandwidth of the difference value between the rated processing bandwidth and the current use bandwidth of the first speed limiter as a second rated bandwidth of a second speed limiter for limiting the speed of the second type of data stream, so that the second rated bandwidth of the second speed limiter is changed along with the current use bandwidth of the first speed limiter.
Specifically, the total amount of the processing bandwidth of the data receiving device is constant, in order to ensure that the data receiving device can timely and effectively receive the first type of data streams, the second rated bandwidth of the second speed limiter which limits the speed of the second type of data streams is set as a surplus bandwidth which is a difference value between a rated processing bandwidth of the data receiving device and a currently used bandwidth of the first speed limiter, and the second rated bandwidth of the second speed limiter is used as a dynamic value to follow a change of the currently used bandwidth of the first speed limiter to realize dynamic adjustment, when the data size of the first type of data streams is large and occupies a large amount of bandwidth, the second rated bandwidth will be reduced therewith, and when the data size of the first type of data streams is small and occupies a small amount of bandwidth, the second rated bandwidth will be increased therewith, for example, the rated processing bandwidth of the data receiving device is M, the currently used bandwidth of the first speed limiter is P, and the second rated bandwidth is V2, where V2 is V2= M-P.
Specifically, the second rated bandwidth changes along with the current used bandwidth of the first speed limiter, so that the bandwidth of the whole data receiving device is ensured to be capable of reaching the maximum value without being influenced by the second type of data stream on the basis of the first type of data stream during data transmission, the transmission bandwidth of the second type of data stream is influenced by the current used bandwidth of the first type of data stream, the bandwidth of the data receiving device is ensured to be preferentially served for the first type of data stream, meanwhile, when the current used bandwidth of the first speed limiter is small, the residual bandwidth of the data receiving device is provided for the second speed limiter, the second rated bandwidth of the second speed limiter is increased, the whole rated processing bandwidth of the data receiving device is ensured to be effectively used, and the situation of bandwidth waste is reduced.
It can be seen that, in the embodiments of the present invention, a first rated bandwidth is set for a first speed limiter that limits speed for a first type of data stream by using a rated processing bandwidth of a data receiving device, a maximum forwarding bandwidth of the first speed limiter is set by using a maximum processing bandwidth of the data receiving device, it is ensured that an upper limit of a bandwidth of the first speed limiter is consistent with the data receiving device, it is ensured that the first type of data stream can share the most bandwidth resources, meanwhile, the maximum forwarding bandwidth is set, so that the first speed limiter has a capability of bearing instantaneous overload of the first type of data stream, and a second rated bandwidth of a second speed limiter that limits speed for a second type of data stream is a difference between the rated processing bandwidth of the data receiving device and a current used bandwidth of the first speed limiter, so that the bandwidth that the second speed limiter can be changed with the use of the first type of data stream, thereby implementing dynamic current limiting on the second type of data stream, and ensuring preferential transmission of the first type of data stream.
The embodiment of the invention discloses a specific dynamic current limiting method for data transmission, and compared with the previous embodiment, the technical scheme is further explained and optimized in the embodiment. Referring to fig. 2, specifically:
s21: and setting the token placing rate of the token bucket speed limiter for limiting the speed of the first class of data flow by utilizing the rated processing bandwidth of the data receiving equipment and the data volume corresponding to each token.
Specifically, first overspeed governor can be token bucket overspeed governor, and when first overspeed governor was token bucket overspeed governor, the first rated bandwidth of first overspeed governor was divided by the data volume that can forward that each token of token bucket overspeed governor corresponds, obtains the token of token bucket overspeed governor and places the rate.
The forwarding data amount corresponding to each token is preset and can be set according to actual application requirements.
S22: and setting the token capacity of the token bucket speed limiter by using the maximum processing bandwidth of the data receiving equipment and the data amount corresponding to each token.
Specifically, because a certain number of tokens can be stored in advance in the token bucket speed limiter, even if the first-class data stream is instantaneously overloaded, and the tokens required by the data volume in unit time are greater than the token placement rate of the token bucket speed limiter, the remaining tokens in the token bucket can distribute tokens for the excessive data to realize overload transmission, and the upper limit of the overload transmission is the maximum processing bandwidth of the data receiving equipment, so that the token capacity of the token bucket speed limiter is set as the quotient of dividing the maximum processing bandwidth by the data volume corresponding to each token, and the transient overload phenomenon that the token bucket speed limiter can bear the data stream is ensured.
S23: and setting the token generation rate of the token speed limiter aiming at the second class data flow speed limit by utilizing the difference surplus bandwidth between the rated processing bandwidth and the current used bandwidth of the token bucket speed limiter and the data amount corresponding to each token.
Specifically, in order to save computational resources, the second speed limiter of the second type of data stream does not select a token bucket speed limiter, but adopts a token speed limiter, and does not have the capability of coping with instantaneous overload of the data stream, so that the token generation rate of the token speed limiter is equivalent to the quotient of a second rated bandwidth of the second speed limiter divided by the data amount corresponding to each token, and once the number of tokens required by the data amount of the second type of data stream exceeds the token generation rate, data congestion is generated; the automatic dynamic current limitation of the second class data stream is realized by dynamically adjusting the token generation rate of the token speed limiter, and the first class data stream is ensured to have enough bandwidth for use.
Further, a second speed limiter can be set as a token bucket speed limiter according to actual application requirements, and at the moment, the capacity of the token bucket can be set according to the actual application requirements.
Correspondingly, the embodiment of the present invention further discloses a dynamic current limiting system for data transmission, as shown in fig. 3, the system includes:
a first rated bandwidth setting module 1, configured to set a first rated bandwidth of a first speed limiter for limiting the speed of a first type of data stream by using a rated processing bandwidth of a data receiving device;
a maximum bandwidth setting module 2, configured to set a maximum forwarding bandwidth of the first speed limiter by using a maximum processing bandwidth of the data receiving device;
and the second rated bandwidth setting module 3 is configured to use a surplus bandwidth of a difference value between the rated processing bandwidth and the current used bandwidth of the first speed limiter as a second rated bandwidth of a second speed limiter for limiting the speed of the second type of data stream, so that the second rated bandwidth of the second speed limiter varies along with the current used bandwidth of the first speed limiter.
Specifically, the first rated bandwidth setting module 1 is specifically configured to set a token placing rate of the token bucket speed limiter for the first type of data flow by using a rated processing bandwidth of the data receiving device and a data amount corresponding to each token.
Specifically, the maximum bandwidth setting module 2 is specifically configured to set the token capacity of the token bucket rate limiter by using the maximum processing bandwidth of the data receiving device and the data amount corresponding to each token.
Specifically, the second rated bandwidth setting module 3 is specifically configured to set a token generation rate of the token rate limiter for the second type of data stream by using a difference surplus bandwidth between the rated processing bandwidth and a currently used bandwidth of the token bucket rate limiter and a data amount corresponding to each token.
In addition, the embodiment of the invention also discloses a data transmission dynamic current limiting device, which comprises:
a memory for storing a computer program;
a processor, configured to execute a computer program to implement the method for dynamic current limiting in data transmission as described above, specifically, the method includes:
setting a first rated bandwidth of a first speed limiter aiming at the speed limit of the first type of data stream by using the rated processing bandwidth of the data receiving equipment;
setting the maximum forwarding bandwidth of the first speed limiter by using the maximum processing bandwidth of the data receiving equipment;
and utilizing the surplus bandwidth of the difference value between the rated processing bandwidth and the current use bandwidth of the first speed limiter as a second rated bandwidth of a second speed limiter for limiting the speed of the second type of data stream, so that the second rated bandwidth of the second speed limiter is changed along with the current use bandwidth of the first speed limiter.
Specifically, the process of setting a first rated bandwidth of a first speed limiter for limiting the speed of the first type of data stream by using the rated processing bandwidth of the data receiving device includes:
and setting the token placing rate of the token bucket speed limiter aiming at the first class of data flow by utilizing the rated processing bandwidth of the data receiving equipment and the data amount corresponding to each token.
Specifically, the process of setting the maximum forwarding bandwidth of the first speed limiter by using the maximum processing bandwidth of the data receiving device includes:
and setting the token capacity of the token bucket speed limiter by using the maximum processing bandwidth of the data receiving equipment and the data amount corresponding to each token.
Specifically, the process of using the surplus bandwidth of the difference between the rated processing bandwidth and the current used bandwidth of the first speed limiter as the second rated bandwidth of the second speed limiter for limiting the second type of data stream includes:
and setting the token generation rate of the token speed limiter for the second class of data flow by using the difference surplus bandwidth of the rated processing bandwidth and the current used bandwidth of the token bucket speed limiter and the data amount corresponding to each token.
In addition, an embodiment of the present invention further discloses a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the method for dynamic current limiting in data transmission is implemented, where the method specifically includes:
setting a first rated bandwidth of a first speed limiter aiming at the speed limit of the first type of data stream by using the rated processing bandwidth of the data receiving equipment;
setting the maximum forwarding bandwidth of a first speed limiter by using the maximum processing bandwidth of data receiving equipment;
and utilizing a surplus bandwidth of the difference value of the rated processing bandwidth and the current use bandwidth of the first speed limiter as a second rated bandwidth of a second speed limiter for limiting the speed of the second type of data stream, so that the second rated bandwidth of the second speed limiter is changed along with the current use bandwidth of the first speed limiter.
Specifically, the process of setting a first rated bandwidth of a first speed limiter for limiting the speed of the first type of data stream by using the rated processing bandwidth of the data receiving device includes:
and setting the token placing rate of the token bucket speed limiter aiming at the first class of data flow by utilizing the rated processing bandwidth of the data receiving equipment and the data amount corresponding to each token.
Specifically, the process of setting the maximum forwarding bandwidth of the first speed limiter by using the maximum processing bandwidth of the data receiving device includes:
and setting the token capacity of the token bucket speed limiter by using the maximum processing bandwidth of the data receiving equipment and the data amount corresponding to each token.
Specifically, the process of using the surplus bandwidth of the difference between the rated processing bandwidth and the current used bandwidth of the first speed limiter as the second rated bandwidth of the second speed limiter for limiting the second type of data stream includes:
and setting the token generation rate of the token speed limiter aiming at the second type data flow by utilizing the difference surplus bandwidth between the rated processing bandwidth and the current using bandwidth of the token bucket speed limiter and the data amount corresponding to each token.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrases "comprising a," "8230," "8230," or "comprising" does not exclude the presence of additional like elements in a process, method, article, or apparatus that comprises the element.
Those of skill would further appreciate that the various illustrative components and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the components and steps of the various examples have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
The technical content provided by the present invention is described in detail above, and the principle and the implementation of the present invention are explained by applying specific examples herein, and the description of the above examples is only used to help understanding the method of the present invention and the core idea thereof; meanwhile, for a person skilled in the art, according to the idea of the present invention, the specific embodiments and the application range may be changed, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims (10)

1. A dynamic current limiting method for data transmission is characterized by comprising the following steps:
setting a first rated bandwidth of a first speed limiter aiming at the speed limit of the first type of data stream by using the rated processing bandwidth of the data receiving equipment; wherein the first rated bandwidth is equal to the nominal processing bandwidth such that the first rated bandwidth of the first rate limiter is maximized;
setting the maximum forwarding bandwidth of the first speed limiter by using the maximum processing bandwidth of the data receiving equipment; the maximum forwarding bandwidth is equal to the maximum processing bandwidth, and the maximum processing bandwidth is greater than the rated processing bandwidth, so that the data receiving equipment and the first speed limiter can cope with the situation that the first type of data flow exceeds a first rated bandwidth within a certain time;
utilizing a surplus bandwidth of a difference value between the rated processing bandwidth and the current use bandwidth of the first speed limiter as a second rated bandwidth of a second speed limiter for limiting the speed of a second type of data stream, so that the second rated bandwidth of the second speed limiter is changed along with the current use bandwidth of the first speed limiter;
wherein the first type of data flow has a higher priority than the second type of data flow.
2. The method for dynamically limiting data transmission according to claim 1, wherein the step of setting a first rated bandwidth of a first speed limiter for a first class of data stream speed limits using a rated processing bandwidth of a data receiving device comprises:
and setting the token placing rate of the token bucket speed limiter aiming at the first class of data flow by utilizing the rated processing bandwidth of the data receiving equipment and the data volume corresponding to each token.
3. The method for dynamically limiting current in data transmission according to claim 2, wherein the step of setting the maximum forwarding bandwidth of the first speed limiter using the maximum processing bandwidth of the data receiving device comprises:
and setting the token capacity of the token bucket speed limiter by using the maximum processing bandwidth of the data receiving equipment and the data amount corresponding to each token.
4. The method of claim 3, wherein the utilizing a surplus bandwidth of the difference between the nominal processing bandwidth and the currently used bandwidth of the first rate limiter as a second nominal bandwidth for a second rate limiter for a second type of data flow rate limit comprises:
and setting a token generation rate of the token speed limiter aiming at the second type data flow by utilizing a difference surplus bandwidth between the rated processing bandwidth and the current used bandwidth of the token bucket speed limiter and a data amount corresponding to each token.
5. A dynamic current limiting system for data transmission, comprising:
the first rated bandwidth setting module is used for setting a first rated bandwidth of a first speed limiter aiming at the speed limit of the first type of data stream by using the rated processing bandwidth of the data receiving equipment; wherein the first rated bandwidth is equal to the nominal processing bandwidth such that the first rated bandwidth of the first speed limiter is at a maximum;
the maximum bandwidth setting module is used for setting the maximum forwarding bandwidth of the first speed limiter by using the maximum processing bandwidth of the data receiving equipment; the maximum forwarding bandwidth is equal to the maximum processing bandwidth, and the maximum processing bandwidth is greater than the rated processing bandwidth, so that the data receiving equipment and the first speed limiter can cope with the situation that the first type of data flow exceeds a first rated bandwidth within a certain time;
a second rated bandwidth setting module, configured to use a surplus bandwidth of a difference between the rated processing bandwidth and a current used bandwidth of the first speed limiter as a second rated bandwidth of a second speed limiter for limiting a second type of data stream, so that the second rated bandwidth of the second speed limiter varies along with the current used bandwidth of the first speed limiter;
wherein the first type of data flow has a higher priority than the second type of data flow.
6. The system according to claim 5, wherein the first bandwidth rating setting module is configured to set a token placement rate of the token bucket rate limiter for the first type of data flow, specifically using a rated processing bandwidth of a data receiving device and a data amount corresponding to each token.
7. The system according to claim 6, wherein the maximum bandwidth setting module is specifically configured to set a token capacity of the token bucket rate limiter by using a maximum processing bandwidth of the data receiving device and a data amount corresponding to each token.
8. The system according to claim 7, wherein the second nominal bandwidth setting module is configured to set a token generation rate of the token bucket rate limiter for the second type of data flow, using a surplus bandwidth of a difference between the nominal processing bandwidth and a currently used bandwidth of the token bucket rate limiter and a data amount corresponding to each token.
9. A dynamic current limiting apparatus for data transmission, comprising:
a memory for storing a computer program;
a processor for executing the computer program to implement the method of data transmission dynamic current limiting as claimed in any of claims 1 to 4.
10. A computer-readable storage medium, having stored thereon a computer program which, when executed by a processor, causes the processor to implement the method of data transmission dynamic current limiting as claimed in any one of claims 1 to 4.
CN201910995272.2A 2019-10-18 2019-10-18 Dynamic current limiting method, system and device for data transmission and readable storage medium Active CN110753004B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910995272.2A CN110753004B (en) 2019-10-18 2019-10-18 Dynamic current limiting method, system and device for data transmission and readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910995272.2A CN110753004B (en) 2019-10-18 2019-10-18 Dynamic current limiting method, system and device for data transmission and readable storage medium

Publications (2)

Publication Number Publication Date
CN110753004A CN110753004A (en) 2020-02-04
CN110753004B true CN110753004B (en) 2023-02-24

Family

ID=69278944

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910995272.2A Active CN110753004B (en) 2019-10-18 2019-10-18 Dynamic current limiting method, system and device for data transmission and readable storage medium

Country Status (1)

Country Link
CN (1) CN110753004B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114070793B (en) * 2020-07-29 2024-09-17 华为技术有限公司 Traffic speed limiting method, related network device and storage medium
CN114598649B (en) * 2022-03-17 2023-08-04 苏州浪潮智能科技有限公司 Kernel bandwidth management method, device, storage equipment and storage medium
CN117240796B (en) * 2023-11-14 2024-02-23 苏州元脑智能科技有限公司 Network card speed limiting method, system, equipment and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1770711A (en) * 2005-11-18 2006-05-10 史文勇 Method and system for measuring bottleneck bandwidth and remanent bandwidth
CN101808033A (en) * 2010-03-09 2010-08-18 杭州华三通信技术有限公司 Method and apparatus for allocating reservation bandwidth of traffic
CN107347198A (en) * 2016-05-05 2017-11-14 北京金山云网络技术有限公司 A kind of method for limiting speed, Control for Speed Limitation node and speed limiting device
CN108804043A (en) * 2018-06-26 2018-11-13 郑州云海信息技术有限公司 Distributed block storage system bandwidth traffic control method, device, equipment and medium

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7327682B2 (en) * 2003-06-27 2008-02-05 Cisco Technology, Inc. Methods and devices for flexible bandwidth allocation

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1770711A (en) * 2005-11-18 2006-05-10 史文勇 Method and system for measuring bottleneck bandwidth and remanent bandwidth
CN101808033A (en) * 2010-03-09 2010-08-18 杭州华三通信技术有限公司 Method and apparatus for allocating reservation bandwidth of traffic
CN107347198A (en) * 2016-05-05 2017-11-14 北京金山云网络技术有限公司 A kind of method for limiting speed, Control for Speed Limitation node and speed limiting device
CN108804043A (en) * 2018-06-26 2018-11-13 郑州云海信息技术有限公司 Distributed block storage system bandwidth traffic control method, device, equipment and medium

Also Published As

Publication number Publication date
CN110753004A (en) 2020-02-04

Similar Documents

Publication Publication Date Title
CN110753004B (en) Dynamic current limiting method, system and device for data transmission and readable storage medium
US10135753B2 (en) System to share network bandwidth among competing applications
US7039715B2 (en) Methods and systems for a receiver to allocate bandwidth among incoming communications flows
CN109951347B (en) Service identification method, device and network equipment
CN107920031B (en) Adaptive adjustment method and device for access bandwidth
CN103532873B (en) flow control policy applied to distributed file system
CN107800574B (en) Storage QOS adjusting method, system, equipment and computer readable memory
CN104301243B (en) A kind of load control method and device
WO2020063206A1 (en) Flexible scaling method for microservice instances, device, and storage medium
WO2011137727A1 (en) Method and system for transmitting message
CN101945082A (en) Method for automatically adjusting network downloading speed and network downloading equipment thereof
WO2024022443A1 (en) Resource autoscaling method and apparatus, and device
US7155533B2 (en) Procedure and controller for a packet-oriented data network for the transmission of data in variable time slots
CN114286447A (en) Method, device and storage medium for adjusting scheduling priority
CN112260962B (en) Bandwidth control method and device
CN117336300A (en) Resource management system for state machine
CN112350954B (en) Overload protection method, system, computer readable storage medium and electronic device
CN109739513B (en) Dynamic scheduling method and device for service requests under multi-edge cloud
CN114828050B (en) Method, device, equipment and medium for determining service capacity
CN104219169A (en) CBQ (Class Based Queuing) scheduling method and device
CN108882296A (en) A kind of method and device handling message
CN108768886A (en) A kind of SaaS data access increased quality method
CN103686874B (en) Bandwidth allocation method
CN112684988A (en) QoS method and system based on distributed storage
CN114024913A (en) Network performance optimization method, device, equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant