CN117459458A - Flow control method, system and storage medium based on cloud service - Google Patents
Flow control method, system and storage medium based on cloud service Download PDFInfo
- Publication number
- CN117459458A CN117459458A CN202311316618.4A CN202311316618A CN117459458A CN 117459458 A CN117459458 A CN 117459458A CN 202311316618 A CN202311316618 A CN 202311316618A CN 117459458 A CN117459458 A CN 117459458A
- Authority
- CN
- China
- Prior art keywords
- service node
- flow control
- threshold level
- performance parameters
- cloud service
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 35
- 238000011217 control strategy Methods 0.000 claims abstract description 18
- 238000012545 processing Methods 0.000 claims description 10
- 238000013508 migration Methods 0.000 claims description 9
- 230000005012 migration Effects 0.000 claims description 9
- 238000012795 verification Methods 0.000 claims description 7
- 230000003247 decreasing effect Effects 0.000 claims description 6
- 238000004590 computer program Methods 0.000 claims description 3
- 238000012544 monitoring process Methods 0.000 claims description 3
- 230000007547 defect Effects 0.000 description 5
- 230000004044 response Effects 0.000 description 5
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000002035 prolonged effect Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
- H04L47/29—Flow control; Congestion control using a combination of thresholds
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention belongs to the technical field of flow control, and particularly relates to a flow control method, a flow control system and a storage medium based on cloud service, wherein the flow control method comprises the following steps: acquiring performance parameters of each service node, and calculating load data values of each service node according to the performance parameters; responding to a sending request of a client, and distributing the request to a service node with a small value according to the size of the load data value; combining the incoming data traffic with a preset dynamic control strategy, and dynamically updating the threshold level of the corresponding service node to perform traffic control; wherein the number of levels of the threshold level is a plurality. The invention can dynamically update the threshold level of the corresponding service node based on the data flow and the preset dynamic control strategy so as to control the flow; therefore, the flow threshold is not fixed, and the control is more flexible and convenient.
Description
Technical Field
The invention belongs to the technical field of flow control, and particularly relates to a flow control method, a flow control system and a storage medium based on cloud service.
Background
The Internet of things industry rapidly develops, the traditional enterprises are actively transformed, and huge market demands of Internet of things connection type services are promoted. Cloud services are based on the increasing, using and interaction modes of internet related services, and the appearance of the cloud services means that the number of connections of the cloud services is huge; at the same time, the traffic sent from the client to the cloud platform server will also be swelled, and the resources in the cloud platform are consumed sharply.
In order to ensure the performance of cloud service, network traffic needs to be controlled, the traditional traffic control generally adopts a configuration pre-allocation strategy, and when a platform is deployed, each service node performs traffic control according to an allocated static threshold value, and requests exceeding the traffic control threshold value are refused to be accessed; or forwarding based on configured routing rules.
By adopting the control mode, the threshold value is fixed, so that the control mode is single, and the network flow cannot be flexibly controlled.
Disclosure of Invention
In order to overcome the defects in the prior art, the invention aims to provide a flow control method, a flow control system and a storage medium based on cloud services.
In a first aspect, the present invention provides a flow control method based on cloud service, applied to a server, the method comprising the following steps:
acquiring performance parameters of each service node, and calculating load data values of each service node according to the performance parameters;
responding to a sending request of a client, and distributing the request to a service node with a small value according to the size of the load data value;
combining the incoming data traffic with a preset dynamic control strategy, and dynamically updating the threshold level of the corresponding service node to perform traffic control; wherein the number of levels of the threshold level is a plurality.
Preferably, the method further comprises the steps of:
calculating the time required by the current service node to finish data processing;
and if the time is smaller than the set waiting threshold, sending a verification request to the client so as to realize data delay.
Preferably, the method further comprises:
calculating the association relation between each service node and the switch;
judging whether the association adjustment of the switch exists or not according to preset adjustment conditions;
if so, the switch in the domain is migrated to other service nodes to reduce resource consumption.
Preferably, the dynamic control strategy comprises:
judging whether the value of the data flow triggers dynamic update or not;
if yes, the threshold level is increased or decreased according to the performance parameters of the current service node.
In a second aspect, a flow control system based on cloud service is applied to a server, and includes:
the monitoring module is used for acquiring the performance parameters of each service node and calculating the load data value of each service node according to the performance parameters;
the distribution module is used for responding to the sending request of the client and distributing the request to the service node with small value according to the size of the load data value;
the control module is used for combining the incoming data flow with a preset dynamic control strategy, and dynamically updating the threshold level of the corresponding service node so as to control the flow; wherein the number of levels of the threshold level is a plurality.
Preferably, the control module is further configured to:
calculating the time required by the current service node to finish data processing;
and if the time is smaller than the set waiting threshold, sending a verification request to the client so as to realize data delay.
Preferably, the dynamic control strategy comprises:
judging whether the value of the data flow triggers dynamic update or not;
if yes, the threshold level is increased or decreased according to the performance parameters of the current service node.
Preferably, the control module is further configured to:
calculating the association relation between each service node and the switch;
judging whether the association adjustment of the switch exists or not according to preset adjustment conditions;
if so, the switch in the domain is migrated to other service nodes to reduce resource consumption.
Preferably, the adjustment conditions are:
each service node is not overloaded;
the resource consumption after migration is smaller than the resource consumption before migration.
In a third aspect, the present invention provides a storage medium storing a computer program comprising program instructions which, when executed by a processor, cause the processor to perform the method of the first aspect.
The beneficial effects of the invention are as follows: the method comprises the steps of firstly obtaining load data values of all service nodes according to performance parameters; distributing the request to the service node with small value; then dynamically updating the threshold level of the corresponding service node based on the data flow and a preset dynamic control strategy so as to control the flow; therefore, the reliability of the processed service node performance is ensured, the response can be timely carried out, and the corresponding threshold level is dynamically adjusted according to the network flow condition, so that the flow threshold is not fixed, and the control is more flexible and convenient; the method overcomes the defect that the threshold value is fixed and the network flow cannot be flexibly controlled in the prior art.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below. Like elements or portions are generally identified by like reference numerals throughout the several figures. In the drawings, elements or portions thereof are not necessarily drawn to scale.
Fig. 1 is a flowchart of a flow control method based on cloud service according to an embodiment of the present invention;
fig. 2 is a block diagram of a flow control system based on cloud service according to an embodiment of the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are some, but not all embodiments of the invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
It should be understood that the terms "comprises" and "comprising," when used in this specification and the appended claims, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
It is also to be understood that the terminology used in the description of the invention herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in this specification and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
Referring to fig. 1, the present embodiment provides a flow control method based on cloud service, which is applied to a server, and the method includes the following steps:
s101, obtaining performance parameters of each service node, and calculating load data values of each service node according to the performance parameters.
Specifically, the performance parameters include the CPU utilization rate of the service node, the memory utilization rate of the service node, the network bandwidth, the response time, and the like, and weights are respectively assigned to the parameters, so that the load data value of each service node is comprehensively obtained.
S102, responding to the sending request of the client, and distributing the request to the service node with small value according to the size of the load data value.
Specifically, when the request is acquired and transmitted, the request is preferentially allocated to the service node with the smallest load data value according to the calculation result.
S103, dynamically updating the threshold level of the corresponding service node by combining the incoming data flow with a preset dynamic control strategy so as to control the flow; wherein the number of levels of the threshold level is a plurality.
The dynamic control strategy comprises the following steps:
judging whether the value of the data flow triggers dynamic update or not; wherein, whether to trigger dynamic update is judged by presetting an initial threshold value.
If yes, the threshold level is increased or decreased according to the performance parameters of the current service node; specific:
each threshold level corresponds to a judging threshold, and the judging threshold is divided into a heightening threshold or a lowering threshold; if the CPU utilization rate and the memory utilization rate of the performance parameters are less than sixty percent, the current threshold level is adjusted to be higher; if the CPU utilization and the memory utilization are greater than ninety percent, the current threshold level is reduced.
According to the technical scheme, load data values of all service nodes are obtained according to performance parameters; distributing the request to the service node with small value; then dynamically updating the threshold level of the corresponding service node based on the data flow and a preset dynamic control strategy so as to control the flow; therefore, the reliability of the processed service node performance is ensured, the response can be timely carried out, and the corresponding threshold level is dynamically adjusted according to the network flow condition, so that the flow threshold is not fixed, and the control is more flexible and convenient; the method overcomes the defect that the threshold value is fixed and the network flow cannot be flexibly controlled in the prior art.
Further, in implementation, considering that the requirement is still not satisfied by means of a dynamic threshold, in another embodiment, on the basis of the above scheme, the method further includes the following steps:
calculating the time required by the current service node to finish data processing;
and if the time is smaller than the set waiting threshold, sending a verification request to the client so as to realize data delay.
That is, by sending the verification request, the arrival time of the subsequent request is prolonged, so that the service node can process the current data, and further, the conditions of data congestion and untimely processing are reduced.
Further, to reduce resource consumption during the transfer, the method further comprises:
calculating the association relation between each service node and the switch;
judging whether the association adjustment of the switch exists or not according to preset adjustment conditions;
if so, the switch in the domain is migrated to other service nodes to reduce resource consumption.
Specifically, each service node calculates control resource consumption and control traffic overhead generated by each data flow in the domain, in order to reduce self resource consumption to the maximum extent, the service node migrates the switch in the domain to other service nodes, and the condition for completing switch migration is the adjustment condition, which includes:
each service node is not overloaded;
the resource consumption after migration is smaller than the resource consumption before migration; this way, unnecessary traffic overhead is reduced by the change of path.
Referring to fig. 2, the present embodiment further provides a flow control system based on cloud service, which is applied to a server, and includes:
the monitoring module is used for acquiring the performance parameters of each service node and calculating the load data value of each service node according to the performance parameters;
the distribution module is used for responding to the sending request of the client and distributing the request to the service node with small value according to the size of the load data value;
the control module is used for combining the incoming data flow with a preset dynamic control strategy, and dynamically updating the threshold level of the corresponding service node so as to control the flow; wherein the number of levels of the threshold level is a plurality.
In this embodiment, the performance parameters include CPU utilization of the service node, memory utilization of the service node, network bandwidth, response time, and the like, and weights are respectively assigned to each parameter, so as to comprehensively obtain load data values of each service node;
the dynamic control strategy comprises the following steps:
judging whether the value of the data flow triggers dynamic update or not; judging whether to trigger dynamic update or not by presetting an initial threshold value;
if yes, the threshold level is increased or decreased according to the performance parameters of the current service node.
According to the scheme, the load data value of each service node is obtained according to the performance parameters; distributing the request to the service node with small value; then dynamically updating the threshold level of the corresponding service node based on the data flow and a preset dynamic control strategy so as to control the flow; therefore, the reliability of the processed service node performance is ensured, the response can be timely carried out, and the corresponding threshold level is dynamically adjusted according to the network flow condition, so that the flow threshold is not fixed, and the control is more flexible and convenient; the method overcomes the defect that the threshold value is fixed and the network flow cannot be flexibly controlled in the prior art.
Further, to reduce the situation of data congestion and untimely processing, the control module is further configured to:
calculating the time required by the current service node to finish data processing;
and if the time is smaller than the set waiting threshold, sending a verification request to the client so as to realize data delay.
Further, in another embodiment, the control module is further configured to:
calculating the association relation between each service node and the switch;
judging whether the association adjustment of the switch exists or not according to preset adjustment conditions;
if so, migrating the switch in the domain to other service nodes so as to reduce resource consumption; wherein, the adjustment condition is:
each service node is not overloaded;
the resource consumption after migration is smaller than the resource consumption before migration.
It should be noted that, regarding the more specific workflow and beneficial effects of the control system, please refer to the foregoing method embodiment section, and the description thereof is omitted herein;
the above solution may also be directly applied as a flow control method and system, and the specific solution is the same as the foregoing embodiment of the flow control method and system based on cloud service, which is not described herein.
The present invention also provides a storage medium storing a computer program comprising program instructions which, when executed by a processor, cause the processor to perform the method of the method embodiment.
It should be appreciated that in embodiments of the present invention, the processor is used to run or execute an operating system, various software programs, and its own set of instructions, which are stored in an internal memory. Processors may include, but are not limited to, one or more of a Central Processing Unit (CPU), a general purpose image processor (GPU), a Microprocessor (MCU), a Digital Signal Processor (DSP), a Field Programmable Gate Array (FPGA), and an Application Specific Integrated Circuit (ASIC).
The computer-readable storage medium may include Cache (RAM), high-speed Random Access Memory (RAM), such as double data rate synchronous dynamic random access memory (DDR SDRAM), as is common, and may also include non-volatile memory (NVRAM), such as one or more read-only memory (ROM), magnetic disk storage devices, flash memory (Flash) memory devices, or other non-volatile solid-state memory devices, such as compact discs (CD-ROM, DVD-ROM), floppy disks, or data tapes, among others.
When the program instructions are executed by the processor, the storage medium provided by the embodiment firstly obtains the load data value of each service node according to the performance parameters; distributing the request to the service node with small value; based on the data flow and a preset dynamic control strategy, dynamically updating the threshold level of the corresponding service node to control the flow, so that the flow threshold is not fixed, and the control is more flexible and convenient; the method overcomes the defect that the threshold value is fixed and the network flow cannot be flexibly controlled in the prior art.
Those of ordinary skill in the art will appreciate that the elements and method steps of each example described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the elements and steps of each example have been described generally in terms of functionality in the foregoing description to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
In several embodiments provided herein, it should be understood that the described systems and methods may be implemented in other ways. For example, the system embodiments described above are merely illustrative, e.g., the division of the modules is merely a logical function division, and there may be additional divisions when actually implemented, e.g., multiple modules or components may be combined or integrated into another system, or some features may be omitted or not performed.
In addition, each functional module in the embodiments of the present invention may be integrated in one processing unit, or each module may exist alone physically, or two or more modules may be integrated in one unit. The integrated units may be implemented in hardware or in software functional modules.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present invention, and not for limiting the same; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some or all of the technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit of the invention, and are intended to be included within the scope of the appended claims and description.
Claims (10)
1. A flow control method based on cloud service, which is applied to a server, the method comprising the following steps:
acquiring performance parameters of each service node, and calculating load data values of each service node according to the performance parameters;
responding to a sending request of a client, and distributing the request to a service node with a small value according to the size of the load data value;
combining the incoming data traffic with a preset dynamic control strategy, and dynamically updating the threshold level of the corresponding service node to perform traffic control; wherein the number of levels of the threshold level is a plurality.
2. The cloud service-based flow control method of claim 1, further comprising the steps of:
calculating the time required by the current service node to finish data processing;
and if the time is smaller than the set waiting threshold, sending a verification request to the client so as to realize data delay.
3. The cloud service-based flow control method of claim 1, further comprising:
calculating the association relation between each service node and the switch;
judging whether the association adjustment of the switch exists or not according to preset adjustment conditions;
if so, the switch in the domain is migrated to other service nodes to reduce resource consumption.
4. A method of cloud service based flow control according to any of claims 1 to 3, wherein the dynamic control strategy comprises:
judging whether the value of the data flow triggers dynamic update or not;
if yes, the threshold level is increased or decreased according to the performance parameters of the current service node.
5. A cloud service-based flow control system applied to a server, comprising:
the monitoring module is used for acquiring the performance parameters of each service node and calculating the load data value of each service node according to the performance parameters;
the distribution module is used for responding to the sending request of the client and distributing the request to the service node with small value according to the size of the load data value;
the control module is used for combining the incoming data flow with a preset dynamic control strategy, and dynamically updating the threshold level of the corresponding service node so as to control the flow; wherein the number of levels of the threshold level is a plurality.
6. The cloud service based flow control system of claim 5, wherein said control module is further configured to:
calculating the time required by the current service node to finish data processing;
and if the time is smaller than the set waiting threshold, sending a verification request to the client so as to realize data delay.
7. The cloud service based flow control system of claim 6, wherein said dynamic control strategy comprises:
judging whether the value of the data flow triggers dynamic update or not;
if yes, the threshold level is increased or decreased according to the performance parameters of the current service node.
8. The cloud service based flow control system of claim 5, wherein said control module is further configured to:
calculating the association relation between each service node and the switch;
judging whether the association adjustment of the switch exists or not according to preset adjustment conditions;
if so, the switch in the domain is migrated to other service nodes to reduce resource consumption.
9. The cloud service based flow control system of claim 8, wherein said adjustment condition is:
each service node is not overloaded;
the resource consumption after migration is smaller than the resource consumption before migration.
10. A storage medium storing a computer program comprising program instructions which, when executed by a processor, cause the processor to perform the method of any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311316618.4A CN117459458A (en) | 2023-10-11 | 2023-10-11 | Flow control method, system and storage medium based on cloud service |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311316618.4A CN117459458A (en) | 2023-10-11 | 2023-10-11 | Flow control method, system and storage medium based on cloud service |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117459458A true CN117459458A (en) | 2024-01-26 |
Family
ID=89584532
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311316618.4A Pending CN117459458A (en) | 2023-10-11 | 2023-10-11 | Flow control method, system and storage medium based on cloud service |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117459458A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108762924A (en) * | 2018-05-28 | 2018-11-06 | 郑州云海信息技术有限公司 | A kind of method, apparatus and computer readable storage medium of load balancing |
| US20190182168A1 (en) * | 2017-12-11 | 2019-06-13 | International Business Machines Corporation | Dynamic throttling thresholds |
| CN110996352A (en) * | 2019-12-20 | 2020-04-10 | 众安在线财产保险股份有限公司 | Flow control method and device, computer equipment and storage medium |
| CN111385214A (en) * | 2018-12-27 | 2020-07-07 | 阿里巴巴集团控股有限公司 | Flow control method, device and equipment |
-
2023
- 2023-10-11 CN CN202311316618.4A patent/CN117459458A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20190182168A1 (en) * | 2017-12-11 | 2019-06-13 | International Business Machines Corporation | Dynamic throttling thresholds |
| CN108762924A (en) * | 2018-05-28 | 2018-11-06 | 郑州云海信息技术有限公司 | A kind of method, apparatus and computer readable storage medium of load balancing |
| CN111385214A (en) * | 2018-12-27 | 2020-07-07 | 阿里巴巴集团控股有限公司 | Flow control method, device and equipment |
| CN110996352A (en) * | 2019-12-20 | 2020-04-10 | 众安在线财产保险股份有限公司 | Flow control method and device, computer equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2021213004A1 (en) | Micro-service management system and deployment method, and related device | |
| US7388839B2 (en) | Methods, apparatus and computer programs for managing performance and resource utilization within cluster-based systems | |
| KR102392442B1 (en) | Managing classified network streams | |
| US10257288B2 (en) | System and method for throttling service requests having non-uniform workloads | |
| US11316792B2 (en) | Method and system of limiting traffic | |
| WO2021228103A1 (en) | Load balancing method and apparatus for cloud host cluster, and server | |
| CN112425129A (en) | Method and system for cluster rate limiting in cloud computing system | |
| US20090327459A1 (en) | On-Demand Capacity Management | |
| CN111131486B (en) | Load adjustment method and device of execution node, server and storage medium | |
| WO2015135383A1 (en) | Data migration method, device, and computer system | |
| CN112839081A (en) | Load balancing method of cloud cluster | |
| WO2016049322A1 (en) | Network classification for applications | |
| JP2020080059A (en) | Evaluation device, evaluation method and evaluation program | |
| CN116049085A (en) | Data processing system and method | |
| WO2018144404A1 (en) | Completion-side client throttling | |
| CN111343254B (en) | Client connection method and device and electronic equipment | |
| WO2023179786A1 (en) | Capacity expansion method for network address translation gateway, device and storage medium | |
| CN117459458A (en) | Flow control method, system and storage medium based on cloud service | |
| KR20160025926A (en) | Apparatus and method for balancing load to virtual application server | |
| CN111556142B (en) | Service calling method, device and system | |
| CN112491066A (en) | Load balancing method, device and system, target load balancing equipment and medium | |
| CN112328387A (en) | Multi-tenant-oriented micro-service resource scheduling method | |
| JP2020127097A (en) | Processor and move method | |
| JP2001022595A (en) | Real time processing task controller and computer readable recording medium stored with program of the controller | |
| JP7351400B2 (en) | Service provision system, service provision method, master node, and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |