CN112783641A - Service interface flow control method and device - Google Patents
Service interface flow control method and device Download PDFInfo
- Publication number
- CN112783641A CN112783641A CN201911094612.0A CN201911094612A CN112783641A CN 112783641 A CN112783641 A CN 112783641A CN 201911094612 A CN201911094612 A CN 201911094612A CN 112783641 A CN112783641 A CN 112783641A
- Authority
- CN
- China
- Prior art keywords
- service interface
- interface
- service
- unit time
- calculating
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 49
- 238000004364 calculation method Methods 0.000 claims description 47
- 230000004044 response Effects 0.000 claims description 35
- 238000004590 computer program Methods 0.000 claims description 23
- 239000002699 waste material Substances 0.000 abstract description 6
- 238000005070 sampling Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 230000000694 effects Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 206010033307 Overweight Diseases 0.000 description 1
- 230000003044 adaptive effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
- G06F9/5055—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals considering software capabilities, i.e. software resources associated or available to the machine
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention provides a method and a device for controlling a service interface flow, wherein the method comprises the following steps: acquiring resource use parameters and capability parameters of each service interface of the micro service node; respectively calculating the current limiting threshold value of each service interface according to the resource use parameter and the capability parameter of each service interface of the micro service node; and respectively carrying out flow control on each service interface according to the flow limiting threshold value of each service interface. The method for controlling the flow of the service interface can improve the accuracy of the flow control of the service interface and reduce the waste of resources.
Description
Technical Field
The present invention relates to the field of information processing technologies, and in particular, to a method and an apparatus for controlling a flow of a service interface.
Background
With the continuous development of information technology, the application of micro services is more and more extensive, wherein each micro service node is integrated with one or more service interfaces for other applications to call. At present, in order to ensure the reliability of the operation of the micro service node, a flow limitation or a flow control is usually performed on a service interface of the micro service node, that is, only a certain number of requests are allowed to pass through, and if the number of requests exceeds the threshold, the requests are rejected.
However, in the prior art, usually, the current limiting threshold is set for each service interface of the micro service node based on manual observation of the response condition of each service interface, which is not only inefficient, but also often inaccurate, and easily causes resource waste or insufficient resources.
Disclosure of Invention
The embodiment of the invention provides a method and a device for controlling flow of a service interface, which are used for solving the problems of resource waste or insufficient resources caused by poor accuracy of flow limiting control on the service interface in the prior art.
In order to solve the technical problems, the specific implementation scheme of the invention is as follows:
in a first aspect, an embodiment of the present invention provides a method for controlling a flow of a service interface. The method comprises the following steps:
acquiring resource use parameters and capability parameters of each service interface of the micro service node;
respectively calculating the current limiting threshold value of each service interface according to the resource use parameter and the capability parameter of each service interface of the micro service node;
and respectively carrying out flow control on each service interface according to the flow limiting threshold value of each service interface.
In a second aspect, an embodiment of the present invention further provides a service interface flow control device. The service interface flow control device comprises:
the first acquisition module is used for acquiring resource use parameters and capability parameters of each service interface of the micro service node;
the first calculation module is used for respectively calculating the current limiting threshold value of each service interface according to the resource use parameter and the capability parameter of each service interface of the micro service node;
and the flow control module is used for performing flow control on each service interface according to the flow limiting threshold value of each service interface.
In a third aspect, an embodiment of the present invention further provides a service interface flow control apparatus, including a processor, a memory, and a computer program stored on the memory and executable on the processor, where the computer program, when executed by the processor, implements the steps of the service interface flow control method described above.
In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when executed by a processor, the computer program implements the steps of the service interface flow control method described above.
In the embodiment of the invention, the resource use parameters and the capability parameters of each service interface of the micro service node are obtained; respectively calculating the current limiting threshold value of each service interface according to the resource use parameter and the capability parameter of each service interface of the micro service node; and respectively carrying out flow control on each service interface according to the flow limiting threshold value of each service interface. Because the flow limiting threshold value of each service interface is calculated by integrating the resource use parameter and the capability parameter of each service interface of the micro service node to perform flow control on each service interface, the accuracy of the flow control of the service interfaces can be improved, and the resource waste or the resource insufficiency can be reduced.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments of the present invention will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without inventive exercise.
Fig. 1 is a flowchart of a service interface flow control method according to an embodiment of the present invention;
fig. 2 is a schematic diagram of a network architecture to which the service interface flow control method provided in the embodiment of the present invention is applicable;
fig. 3 is a structural diagram of a flow control apparatus of a service interface according to an embodiment of the present invention;
fig. 4 is a block diagram of a service interface flow control apparatus according to another embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The embodiment of the invention provides a service interface flow control method. Referring to fig. 1, fig. 1 is a flowchart of a service interface flow control method provided by an embodiment of the present invention, as shown in fig. 1, including the following steps:
In this embodiment, the microservice node may be integrated with at least one service interface, and the at least one service interface may be invoked by other applications.
The resource usage parameter of the service interface may refer to a parameter that may reflect the resource usage of the service interface. Optionally, the resource usage parameter of the service interface may include, but is not limited to, at least one of the following: the average using time of the CPU in unit time, the average using size of the memory in unit time, and the average network bandwidth consumption in unit time.
The capability parameter of the service interface may refer to a parameter that may reflect a capability condition of the service interface. Optionally, the capability parameter of the service interface may include, but is not limited to, at least one of the following: the average processing time consumption in unit time, the interface reference response time, the average time consumption for the downstream service interface calling in unit time, and the calling times in unit time.
The unit time may be set reasonably according to actual requirements, for example, the unit time may be 1 minute, 30 seconds, 1 second, or the like, which is not limited in this embodiment.
102, respectively calculating a current limiting threshold value of each service interface according to the resource use parameter and the capability parameter of each service interface of the micro service node.
In this embodiment, the resource usage parameter and the capability parameter of each service interface of the micro service node may be synthesized to calculate the current limiting threshold of each service interface, and the calculation of the current limiting threshold of each service interface not only considers the resource usage parameter and the capability parameter of each service interface, but also considers the resource usage parameter and the capability parameter of other service interfaces, so that the resource of the micro service node may be fully utilized.
And 103, performing flow control on each service interface according to the flow limiting threshold of each service interface.
The service interface flow control method provided by the embodiment of the invention obtains the resource use parameter and the capability parameter of each service interface of the micro service node; respectively calculating the current limiting threshold value of each service interface according to the resource use parameter and the capability parameter of each service interface of the micro service node; and respectively carrying out flow control on each service interface according to the flow limiting threshold value of each service interface. Because the flow limiting threshold value of each service interface is calculated by integrating the resource use parameter and the capability parameter of each service interface of the micro service node to perform flow control on each service interface, the accuracy of the flow control of the service interfaces can be improved, and the resource waste or the resource insufficiency can be reduced.
Optionally, step 102, that is, the calculating the current limiting threshold of each service interface according to the resource usage parameter and the capability parameter of each service interface of the microservice node, may include:
calculating the resource consumption value of each service interface according to the average use time of the CPU in unit time, the average use size of the memory in unit time and the average network bandwidth consumption in unit time of each service interface;
respectively calculating the maximum current limiting threshold of each service interface according to the unit time average processing time consumption, the interface reference response time and the unit time called times of each service interface;
and respectively calculating the current limiting threshold value of each service interface according to the resource consumption value and the maximum current limiting threshold value of each service interface.
In this embodiment, the average usage time of the CPU per unit time may refer to an average usage time of the CPU per unit time of the service interface, and the unit of the average usage time of the CPU per unit time may be milliseconds, for example, the unit time is 1 minute. The average value of the memory usage size in the unit time may be an average value of the memory usage size of the service interface in the unit time, that is, an average value of the memory space occupied by the service interface in the unit time, and the unit of the average value may be a byte. The average of the network bandwidth consumption per unit time may refer to an average of network bandwidth consumed by the service interface per unit time, and the unit of the network bandwidth may be a byte.
The average processing time per unit time may be an average time consumed by the service interface to perform processing within a unit time, and the unit of the average processing time per unit time may be milliseconds, taking 1 minute as an example. The interface reference response time may refer to a reference value of a response time of the service interface, and may have a unit of millisecond. The number of times of call per unit time may be the number of times of call per unit time of the service interface.
Optionally, the calculating the resource consumption value of each service interface according to the average usage time of the CPU in unit time, the average usage size of the memory in unit time, and the average network bandwidth consumption in unit time of each service interface may include: and calculating the resource consumption value of each service interface according to the average use time of the CPU in unit time, the average value of the memory use size in unit time and the average value of the network bandwidth consumption in unit time of each service interface based on a pre-trained machine learning model.
Optionally, the calculating the resource consumption value of each service interface according to the average usage time of the CPU in unit time, the average usage size of the memory in unit time, and the average network bandwidth consumption in unit time of each service interface may include:
respectively calculating the resource consumption value of each service interface according to a calculation formula R ═ cvt × b1+ uvm × b2+ nvm × b 3;
wherein, R represents a resource consumption value, cvt represents an average usage time of the CPU in unit time, uvm represents an average value of memory usage in unit time, nvm represents network bandwidth consumption in unit time, b1 represents a second preset value, b2 represents a third preset value, and b3 represents a fourth preset value.
The b1, b2 and b3 can respectively represent the percentage of cvt, uvm and nvm affecting resource consumption, and all the percentages can be reasonably set according to actual requirements. For example, the value range of the proportion of b1 can be [ 40%, 80% ], and the value range can be [400, 800 ]; the value range of the proportion of the b2 can be [ 10%, 100% ], and the value range can be [0.001, 0.01 ]; the value range of the proportion of b3 can be (0%, 10%), and the value range can be (0, 0.010) ]. in this embodiment, b1 can be preferably 600, b2 can be preferably 0.003, and b3 can be preferably 0.0025.
Specifically, the resource consumption value of each service interface may be calculated by using the above calculation formula according to the average usage time of the CPU in unit time, the average usage size of the memory in unit time, and the average network bandwidth consumption in unit time of each service interface. For example, b1 may be 600, b2 may be 0.003, b3 may be 0.0025, the microservice nodes exist in service interfaces I1 and I2, the average time of use of the CPU per unit time, the average value of the memory use size per unit time, and the network bandwidth consumption per unit time of service interface I1 are 6ms, 128000byte (i.e., bytes), and 32000byte, respectively, and the average time of use of the CPU per unit time, the average value of the memory use size per unit time, and the network bandwidth consumption per unit time of service interface I2 are 45ms, 512000byte, and 16000byte, respectively, so that the resource consumption value R1 of service interface I1 may be 4784, and the resource consumption value R2 of service interface I2 may be 28576.
In this embodiment, the resource consumption value of each service interface is respectively calculated according to the calculation formula R ═ cvt × b1+ uvm × b2+ nvm × b3, so that the calculated resource consumption value of each service interface can more accurately reflect the resource consumption condition of each service interface.
Optionally, the calculating the maximum current limit threshold of each service interface according to the average processing time per unit time, the interface reference response time, and the number of times called per unit time of each service interface may include:
under the condition that a first service interface calls an external interface, calculating the maximum current limiting threshold of the first service interface according to the average processing time per unit time, the reference response time of the interface, the called times per unit time and the average calling time per unit time of a downstream service interface of the first service interface;
under the condition that a first service interface does not have a calling external interface, calculating a maximum current limiting threshold of the first service interface according to the average processing time per unit time, the interface reference response time and the number of times of calling per unit time of the first service interface;
the first service interface is any service interface in the micro service node.
It should be noted that each service interface of the above-mentioned micro service node may calculate the maximum current limit threshold in the manner provided by this embodiment, and this embodiment is only described with the first service interface as an example.
In practical application, under the condition that the external interface is called by the service interface, the capability condition of the service interface is often influenced by the capability of the called external interface, so that in the embodiment, under the condition that the external interface is called by the service interface, the maximum current limiting threshold of the service interface is calculated by integrating the average processing time per unit time of the service interface, the reference response time of the interface, the number of times of being called per unit time and the average time consumed by calling the downstream service interface per unit time. The unit time of the average time consumed for the downstream service interface to call may be an average time consumed for calling the downstream service interface in unit time, and taking the unit time as 1 minute as an example, the unit of the average time consumed for the downstream service interface to call in unit time may be millimeters.
In this embodiment, when the external interface is called by the first service interface, the maximum current limit threshold of the first service interface is calculated according to the average processing consumed time per unit time, the interface reference response time, the number of times that the external interface is called per unit time, and the average consumed time that the downstream service interface is called per unit time of the first service interface.
Optionally, when the external interface is called in the first service interface, calculating the maximum current limit threshold of the first service interface according to the average processing time per unit time of the first service interface, the reference interface response time, the number of times called per unit time, and the average time consumed for calling the downstream service interface per unit time includes:
under the condition that a calling external interface exists in a first service interface, calculating a maximum current limit threshold value of the first service interface according to a calculation formula L (a 1 cc (rt/pvt) (ncvt/pvt);
the calculating the maximum current limit threshold of the first service interface according to the average processing time per unit time, the interface reference response time and the number of times of being called per unit time of the first service interface when the external interface is not called by the first service interface includes:
under the condition that the first service interface does not have a calling external interface, calculating a maximum current limit threshold value of the first service interface according to a calculation formula L (a 1 cc (rt/pvt);
wherein, L represents the maximum current limit threshold, a1 represents a first preset value, cc represents the number of times of call in unit time, rt represents the interface reference response time, pvt represents the average processing time consumption in unit time, and ncvt represents the average time consumption of call of the downstream service interface in unit time.
The a1 can be reasonably set according to actual requirements, for example, the value range of a1 can be [5, 8 ]. In this embodiment, a1 may be preferably selected to be 8.
In this embodiment, when the first service interface has a call external interface, the maximum current limit threshold of the first service interface is calculated according to a calculation formula L ═ a1 × cc (rt/pvt) × (ncvt/pvt); under the condition that the first service interface does not have the calling external interface, the maximum current limiting threshold value of the first service interface is calculated according to a calculation formula L-a 1 cc rt/pvt, so that the maximum current limiting threshold value of the first service interface obtained through calculation can reflect the maximum capacity condition of the first service interface more accurately.
Optionally, before the calculating the current limiting threshold of each service interface according to the resource usage parameter and the capability parameter of each service interface of the microservice node, the method may further include:
acquiring the service level of the micro service node and the interface level of each service interface in the micro service node;
calculating the interface weight of each service interface according to the service level of the micro service node and the interface level of each service interface in the micro service node;
the calculating the current limit threshold of each service interface according to the resource consumption value and the maximum current limit threshold of each service interface may include:
and respectively calculating the current limiting threshold of each service interface according to the resource consumption value, the maximum current limiting threshold and the interface weight of each service interface.
In this embodiment, the service level of the micro service node may be used to reflect the importance degree of the micro service node. Alternatively, the service level may be represented by any one of values from 1 to 255, wherein the larger the value, the higher the service level. The interface level of the service interface may be used to reflect the importance of the service interface. Optionally, the interface level may also be represented by any one of values from 1 to 255, where the larger the value, the higher the interface level.
In this embodiment, the current limit threshold of each service interface is respectively calculated according to the resource consumption value, the maximum current limit threshold and the interface weight of each service interface, so that the normal operation of the service interface with higher importance in the microservice node with higher importance can be preferentially ensured.
Optionally, the calculating an interface weight of each service interface according to the service level of the micro service node and the interface level of each service interface in the micro service node may include:
respectively calculating the interface weight of each service interface according to a calculation formula W (sl + d 1) il;
wherein W represents the interface weight, sl represents the service level, il represents the interface level, and d1 represents the sixth preset value.
The d1 can be reasonably set according to the actual demand and the importance of the influence of the interface level on the interface weight, and the value range of the d1 can be [0.1, 1 ]. In this embodiment, d1 is preferably 0.3. Based on the service level of the micro service node and the interface level of each service interface, the interface weight of each service interface is respectively calculated according to a calculation formula W-sl + d 1-il, so that the calculated interface weight of the service interface can accurately reflect the importance degree or priority of the service interface.
Optionally, before the calculating the current limiting threshold of each service interface according to the resource usage parameter and the capability parameter of each service interface of the microservice node, the method may further include:
acquiring resource use parameters of the micro service nodes, wherein the resource use parameters of the micro service nodes comprise at least one of the following items: CPU utilization rate, memory utilization rate and network bandwidth utilization rate;
calculating a current limiting weighted value according to the resource use parameters of the micro service nodes;
the calculating the current limit threshold of each service interface according to the resource consumption value, the maximum current limit threshold, and the interface weight of each service interface may include:
and respectively calculating the current limiting threshold of each service interface according to the current limiting weighted value, the resource consumption value of each service interface, the maximum current limiting threshold and the interface weight.
In this embodiment, the resource usage parameter of the micro service node may refer to a parameter that can reflect a resource usage condition of the micro service node, where the resource usage parameter of the micro service node may include, but is not limited to, at least one of the following: CPU utilization, memory utilization, and network bandwidth utilization. The current limiting weighted value can visually reflect the use condition of the resources of the micro service node.
Optionally, the calculating a current-limiting weighted value according to the resource usage parameter of the micro service node may include:
calculating a current limiting weighted value according to a calculation formula P ═ c1/max (cvp, mvp, nvp);
wherein P represents a current limit weight value, cvp represents a CPU utilization rate, mvp represents a memory utilization rate, nvp represents a network bandwidth utilization rate, and c1 represents a fifth preset value.
The above can be reasonably set according to actual requirements, for example, the value range of c1 can be [0.1, 0.9 ]. In this embodiment, c1 may be preferably 0.8. Max (cvp, mvp, nvp) above indicates taking the maximum of cvp, mvp, and nvp.
In this embodiment, the current limit threshold of each service interface is respectively calculated according to the current limit weighted value, the resource consumption value of each service interface, the maximum current limit threshold, and the interface weight, so that the calculated current limit threshold of the service interface is more accurate.
Optionally, the calculating the current limit threshold of each service interface according to the current limit weighted value and the resource consumption value, the maximum current limit threshold, and the interface weight of each service interface includes:
according to a calculation formula
Respectively calculating the current limiting threshold value of each service interface;
wherein S isiTo representA current limit threshold, L, of an ith service interface in the microservice nodeiRepresenting a maximum current limit threshold, R, of an ith service interface in the microservice nodeiRepresenting a resource consumption value, W, of an ith service interface in the microservice nodeiAnd expressing the interface weight of the ith service interface in the micro service node, N expressing the number of the service interfaces in the micro service node, and P expressing the current limiting weight value.
In this embodiment, the calculation formula may be based on the current limiting weighted value, the resource consumption value of each service interface, the maximum current limiting threshold, and the interface weight
And respectively calculating the current limiting threshold value of each service interface.
For example, the micro service node a has 3 service interfaces, namely a service interface I1, a service interface I2 and a service interface I3, and the service interface I1 has a call external interface C1; current cvp ═ 0.2, mvp ═ 0.4, nvp ═ 0.05; pvt 546ms, cvt 6ms, uvm 128000byte, nvm 32000byte, calling time ncvt 300ms, cc 60, sl 56, il 20, rt 1500ms for the service interface I1; pvt 1200ms, cvt 45ms, uvm 512000byte, nvm 16000byte, cc 10, sl 56, il 128, rt 2500ms of the service interface I2; the service interface I3 has pvt of 24ms, cvt of 1ms, uvm of 234000byte, nvm of 24000byte, cc of 30, sl of 56, il of 3, and rt of 1000 ms.
Based on the above, the resource consumption value R of the service interface I1 can be obtained according to the calculation formula R ═ cvt × 600+ uvm × 0.003+ nvm × 0.002514784 resource consumption value R of service interface I2228576, resource consumption value R of service interface I331363; according to the calculation formula L-8 cc (rt/pvt) (ncvt/pvt), the maximum current limit threshold L of the service interface I1 can be obtained1712, according to the calculation formula L8 cc (rt/pvt), the maximum current limit threshold L of the service interface I2 can be obtained2166, maximum current limit threshold L of service interface I33439; the interface of the service interface I1 can be obtained according to the calculation formula W ═ sl +0.3 |Weight W1Interface weight W of service interface I2 ═ 62294.4 interface weight W of service interface I1356.9; calculating to obtain a current limiting weight value P of 2 according to a calculation formula P of c1/max (cvp, mvp, nvp); according to the calculation formula
The current limit threshold S of the service interface I1 may be obtained12973 requests/second.
The embodiment calculates the maximum current limit threshold and the interface weight according to the current limit weighted value, the resource consumption value of each service interface and the calculation formula
And respectively calculating the current limiting threshold of each service interface, so that the accuracy of the calculated current limiting threshold can be improved.
The service interface flow control method provided by the embodiment of the invention is described below with reference to fig. 2:
referring to fig. 2, the first micro service node includes interface 1 to interface N1, and the second micro service node includes interface 1 to interface N2, where N1 and N2 may be any integer greater than 1.
Specifically, the flow control related data of each service interface of each micro service node may be acquired at preset time intervals through a flow control configuration synchronization and sampling component deployed or integrated on each micro service node, where the flow control related data may include, but is not limited to, at least one of the following: the average usage time of the CPU per unit time, the average of the memory usage size per unit time, the average of the network bandwidth consumption per unit time, the average processing time per unit time, the interface reference response time, the average time consumed for the downstream service interface invocation per unit time, the number of times the downstream service interface is invoked per unit time, the service level, the interface weight, the CPU utilization, the memory utilization, the network bandwidth utilization, and the like.
The flow control configuration synchronization and sampling component may upload flow control related data of each service interface of each micro service node, which is acquired at preset time intervals, to the flow limiting policy real-time calculation center, and the flow limiting policy real-time calculation center may calculate a flow limiting threshold of each service interface based on the flow control related data of each service interface of each micro service node, where a calculation manner of the flow limiting threshold of each service interface may refer to the related description of the foregoing embodiment, and is not described herein again.
After the current-limiting policy real-time calculation center calculates the current-limiting threshold of each service interface, the flow control configuration synchronization and sampling component pushed to the corresponding micro service node based on the current-limiting configuration management center may take effect of the received flow control configuration through the corresponding flow control configuration synchronization and sampling component, for example, take effect of the received current-limiting threshold of each service interface.
It should be noted that the flow control configuration synchronization and sampling component may be understood as a software module deployed in a micro service node and used for sampling flow control configuration synchronization and flow control related parameters, and the current limiting policy real-time calculation center and the current limiting configuration management center may be understood as a software module deployed in a server different from the micro service node.
In summary, the flow control method for the service interface provided in the embodiment of the present invention can implement adaptive flow-limiting control for the service interface, and only notify the expected acceptable response time of the interface (i.e. the interface reference response time) without manually observing the response condition of the service interface, the appropriate flow-limiting threshold value can be automatically calculated. The current limiting threshold value can be automatically adjusted according to different time periods and different service flow characteristics, so that the core high-weight service can be normally developed, other service interfaces cannot be completely unavailable, and the server and bandwidth resources are utilized to the maximum extent. In addition, the flow control module SDK mode and the micro-service integration can be provided, the service logic is not interfered, the interface weight can be manually adjusted in a flow limiting configuration management center, the service interface does not need to be modified, the deployment mode is simple, the calculation method is simple, and the flow control cost can be greatly saved.
Referring to fig. 3, fig. 3 is a structural diagram of a service interface flow control apparatus according to an embodiment of the present invention. As shown in fig. 3, the service interface flow control apparatus 300 includes:
a first obtaining module 301, configured to obtain a resource usage parameter and a capability parameter of each service interface of a microservice node;
a first calculating module 302, configured to calculate a current limiting threshold of each service interface according to a resource usage parameter and a capability parameter of each service interface of the micro service node;
and a flow control module 303, configured to perform flow control on each service interface according to the flow limiting threshold of each service interface.
Optionally, the resource usage parameter of the service interface includes at least one of: the average using time of a CPU in unit time, the average using size of a memory in unit time and the average network bandwidth consumption in unit time;
the capability parameter of the service interface comprises at least one of: the average processing time consumption in unit time, the interface reference response time, the average time consumption for the downstream service interface calling in unit time, and the calling times in unit time.
Optionally, the first computing module includes:
the first calculation unit is used for calculating the resource consumption value of each service interface according to the average use time of the CPU in unit time, the average use size of the memory in unit time and the average network bandwidth consumption in unit time of each service interface;
the second calculation unit is used for calculating the maximum current limiting threshold of each service interface according to the average processing time per unit time, the interface reference response time and the number of times of being called per unit time of each service interface;
and the third calculating unit is used for respectively calculating the current limiting threshold value of each service interface according to the resource consumption value and the maximum current limiting threshold value of each service interface.
Optionally, the second computing unit is specifically configured to:
under the condition that a first service interface calls an external interface, calculating the maximum current limiting threshold of the first service interface according to the average processing time per unit time, the reference response time of the interface, the called times per unit time and the average calling time per unit time of a downstream service interface of the first service interface;
under the condition that a first service interface does not have a calling external interface, calculating a maximum current limiting threshold of the first service interface according to the average processing time per unit time, the interface reference response time and the number of times of calling per unit time of the first service interface;
the first service interface is any service interface in the micro service node.
Optionally, the second computing unit is specifically configured to:
under the condition that a calling external interface exists in a first service interface, calculating a maximum current limit threshold value of the first service interface according to a calculation formula L (a 1 cc (rt/pvt) (ncvt/pvt);
under the condition that the first service interface does not have a calling external interface, calculating a maximum current limit threshold value of the first service interface according to a calculation formula L (a 1 cc (rt/pvt);
wherein, L represents the maximum current limit threshold, a1 represents a first preset value, cc represents the number of times of call in unit time, rt represents the interface reference response time, pvt represents the average processing time consumption in unit time, and ncvt represents the average time consumption of call of the downstream service interface in unit time.
Optionally, the first computing unit is specifically configured to:
respectively calculating the resource consumption value of each service interface according to a calculation formula R ═ cvt × b1+ uvm × b2+ nvm × b 3;
wherein, R represents a resource consumption value, cvt represents an average usage time of the CPU in unit time, uvm represents an average value of memory usage in unit time, nvm represents network bandwidth consumption in unit time, b1 represents a second preset value, b2 represents a third preset value, and b3 represents a fourth preset value.
Optionally, the apparatus further comprises:
a second obtaining module, configured to obtain a service level of the micro service node and an interface level of each service interface in the micro service node before respectively calculating a current limiting threshold of each service interface according to a resource usage parameter and a capability parameter of each service interface of the micro service node;
the second calculation module is used for calculating the interface weight of each service interface according to the service level of the micro service node and the interface level of each service interface in the micro service node;
the third computing unit is specifically configured to:
and respectively calculating the current limiting threshold of each service interface according to the resource consumption value, the maximum current limiting threshold and the interface weight of each service interface.
Optionally, the apparatus further comprises:
a third obtaining module, configured to obtain resource usage parameters of the micro service node before respectively calculating a current limiting threshold of each service interface according to the resource usage parameters and the capability parameters of each service interface of the micro service node, where the resource usage parameters of the micro service node include at least one of: CPU utilization rate, memory utilization rate and network bandwidth utilization rate;
the fourth calculation module is used for calculating a current limiting weighted value according to the resource use parameters of the micro service nodes;
the third computing unit is specifically configured to:
and respectively calculating the current limiting threshold of each service interface according to the current limiting weighted value, the resource consumption value of each service interface, the maximum current limiting threshold and the interface weight.
Optionally, the third computing unit is specifically configured to:
according to a calculation formula
Respectively calculating the current limiting threshold value of each service interface;
wherein S isiIndicating a current limit threshold, L, for an ith service interface in the microservice nodeiRepresents a maximum current limit threshold for an ith service interface in the microservice node,Rirepresenting a resource consumption value, W, of an ith service interface in the microservice nodeiAnd expressing the interface weight of the ith service interface in the micro service node, N expressing the number of the service interfaces in the micro service node, and P expressing the current limiting weight value.
Optionally, the fourth calculating module is specifically configured to:
calculating a current limiting weighted value according to a calculation formula P ═ c1/max (cvp, mvp, nvp);
wherein P represents a current limit weight value, cvp represents a CPU utilization rate, mvp represents a memory utilization rate, nvp represents a network bandwidth utilization rate, and c1 represents a fifth preset value.
Optionally, the second calculating module is specifically configured to:
respectively calculating the interface weight of each service interface according to a calculation formula W (sl + d 1) il;
wherein W represents the interface weight, sl represents the service level, il represents the interface level, and d1 represents the sixth preset value.
The service interface flow control apparatus 300 provided in the embodiment of the present invention can implement each process in the foregoing method embodiments, and is not described here again to avoid repetition.
In the service interface flow control apparatus 300 of the embodiment of the present invention, the first obtaining module 301 is configured to obtain a resource usage parameter and a capability parameter of each service interface of a microservice node; a first calculating module 302, configured to calculate a current limiting threshold of each service interface according to a resource usage parameter and a capability parameter of each service interface of the micro service node; and a flow control module 303, configured to perform flow control on each service interface according to the flow limiting threshold of each service interface. Because the flow limiting threshold value of each service interface is calculated by integrating the resource use parameter and the capability parameter of each service interface of the micro service node to perform flow control on each service interface, the accuracy of the flow control of the service interfaces can be improved, and the resource waste or the resource insufficiency can be reduced.
Referring to fig. 4, fig. 4 is a block diagram of a service interface flow control apparatus according to another embodiment of the present invention, and as shown in fig. 4, the service interface flow control apparatus 400 includes: a processor 401, a memory 402 and a computer program stored on the memory 402 and operable on the processor, the various components in the data transmission device 400 being coupled together by a bus interface 403, the computer program, when executed by the processor 401, performing the steps of:
acquiring resource use parameters and capability parameters of each service interface of the micro service node;
respectively calculating the current limiting threshold value of each service interface according to the resource use parameter and the capability parameter of each service interface of the micro service node;
and respectively carrying out flow control on each service interface according to the flow limiting threshold value of each service interface.
Optionally, the resource usage parameter of the service interface includes at least one of: the average using time of a CPU in unit time, the average using size of a memory in unit time and the average network bandwidth consumption in unit time;
the capability parameter of the service interface comprises at least one of: the average processing time consumption in unit time, the interface reference response time, the average time consumption for the downstream service interface calling in unit time, and the calling times in unit time.
Optionally, the computer program when executed by the processor 401 is further configured to:
calculating the resource consumption value of each service interface according to the average use time of the CPU in unit time, the average use size of the memory in unit time and the average network bandwidth consumption in unit time of each service interface;
respectively calculating the maximum current limiting threshold of each service interface according to the unit time average processing time consumption, the interface reference response time and the unit time called times of each service interface;
and respectively calculating the current limiting threshold value of each service interface according to the resource consumption value and the maximum current limiting threshold value of each service interface.
Optionally, the computer program when executed by the processor 401 is further configured to:
under the condition that a first service interface calls an external interface, calculating the maximum current limiting threshold of the first service interface according to the average processing time per unit time, the reference response time of the interface, the called times per unit time and the average calling time per unit time of a downstream service interface of the first service interface;
under the condition that a first service interface does not have a calling external interface, calculating a maximum current limiting threshold of the first service interface according to the average processing time per unit time, the interface reference response time and the number of times of calling per unit time of the first service interface;
the first service interface is any service interface in the micro service node.
Optionally, the computer program when executed by the processor 401 is further configured to:
under the condition that a calling external interface exists in a first service interface, calculating a maximum current limit threshold value of the first service interface according to a calculation formula L (a 1 cc (rt/pvt) (ncvt/pvt);
under the condition that the first service interface does not have a calling external interface, calculating a maximum current limit threshold value of the first service interface according to a calculation formula L (a 1 cc (rt/pvt);
wherein, L represents the maximum current limit threshold, a1 represents a first preset value, cc represents the number of times of call in unit time, rt represents the interface reference response time, pvt represents the average processing time consumption in unit time, and ncvt represents the average time consumption of call of the downstream service interface in unit time.
Optionally, the computer program when executed by the processor 401 is further configured to:
respectively calculating the resource consumption value of each service interface according to a calculation formula R ═ cvt × b1+ uvm × b2+ nvm × b 3;
wherein, R represents a resource consumption value, cvt represents an average usage time of the CPU in unit time, uvm represents an average value of memory usage in unit time, nvm represents network bandwidth consumption in unit time, b1 represents a second preset value, b2 represents a third preset value, and b3 represents a fourth preset value.
Optionally, the computer program when executed by the processor 401 is further configured to:
before respectively calculating the current limiting threshold value of each service interface according to the resource use parameter and the capacity parameter of each service interface of the micro service node, acquiring the service level of the micro service node and the interface level of each service interface in the micro service node;
calculating the interface weight of each service interface according to the service level of the micro service node and the interface level of each service interface in the micro service node;
and respectively calculating the current limiting threshold of each service interface according to the resource consumption value, the maximum current limiting threshold and the interface weight of each service interface.
Optionally, the computer program when executed by the processor 401 is further configured to:
the resource usage parameters of the micro service nodes are obtained before the current limiting threshold of each service interface is respectively calculated according to the resource usage parameters and the capability parameters of each service interface of the micro service nodes, and the resource usage parameters of the micro service nodes comprise at least one of the following parameters: CPU utilization rate, memory utilization rate and network bandwidth utilization rate;
calculating a current limiting weighted value according to the resource use parameters of the micro service nodes;
and respectively calculating the current limiting threshold of each service interface according to the current limiting weighted value, the resource consumption value of each service interface, the maximum current limiting threshold and the interface weight.
Optionally, the computer program when executed by the processor 401 is further configured to:
according to a calculation formula
Respectively calculating the current limiting threshold value of each service interface;
wherein S isiIndicating a current limit threshold, L, for an ith service interface in the microservice nodeiRepresents the aboveMaximum current limit threshold, R, of ith service interface in microservice nodeiRepresenting a resource consumption value, W, of an ith service interface in the microservice nodeiAnd expressing the interface weight of the ith service interface in the micro service node, N expressing the number of the service interfaces in the micro service node, and P expressing the current limiting weight value.
Optionally, the computer program when executed by the processor 401 is further configured to:
calculating a current limiting weighted value according to a calculation formula P ═ c1/max (cvp, mvp, nvp);
wherein P represents a current limit weight value, cvp represents a CPU utilization rate, mvp represents a memory utilization rate, nvp represents a network bandwidth utilization rate, and c1 represents a fifth preset value.
Optionally, the computer program when executed by the processor 401 is further configured to:
respectively calculating the interface weight of each service interface according to a calculation formula W (sl + d 1) il;
wherein W represents the interface weight, sl represents the service level, il represents the interface level, and d1 represents the sixth preset value.
The embodiment of the present invention further provides a service interface flow control device, which includes a processor, a memory, and a computer program stored in the memory and capable of running on the processor, where the computer program, when executed by the processor, implements each process of the service interface flow control method embodiment, and can achieve the same technical effect, and is not described herein again to avoid repetition.
The embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements each process of the foregoing service interface flow control method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here. The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.
Claims (14)
1. A method for controlling flow of a service interface, comprising:
acquiring resource use parameters and capability parameters of each service interface of the micro service node;
respectively calculating the current limiting threshold value of each service interface according to the resource use parameter and the capability parameter of each service interface of the micro service node;
and respectively carrying out flow control on each service interface according to the flow limiting threshold value of each service interface.
2. The method of claim 1, wherein the resource usage parameters of the service interface comprise at least one of: the average using time of a CPU in unit time, the average using size of a memory in unit time and the average network bandwidth consumption in unit time;
the capability parameter of the service interface comprises at least one of: the average processing time consumption in unit time, the interface reference response time, the average time consumption for the downstream service interface calling in unit time, and the calling times in unit time.
3. The method of claim 2, wherein the calculating the current limiting threshold of each service interface of the micro service node according to the resource usage parameter and the capability parameter of each service interface respectively comprises:
calculating the resource consumption value of each service interface according to the average use time of the CPU in unit time, the average use size of the memory in unit time and the average network bandwidth consumption in unit time of each service interface;
respectively calculating the maximum current limiting threshold of each service interface according to the unit time average processing time consumption, the interface reference response time and the unit time called times of each service interface;
and respectively calculating the current limiting threshold value of each service interface according to the resource consumption value and the maximum current limiting threshold value of each service interface.
4. The method of claim 3, wherein the calculating the maximum current limit threshold of each service interface according to the average processing time per unit time, the interface reference response time and the number of times called per unit time of each service interface comprises:
under the condition that a first service interface calls an external interface, calculating the maximum current limiting threshold of the first service interface according to the average processing time per unit time, the reference response time of the interface, the called times per unit time and the average calling time per unit time of a downstream service interface of the first service interface;
under the condition that a first service interface does not have a calling external interface, calculating a maximum current limiting threshold of the first service interface according to the average processing time per unit time, the interface reference response time and the number of times of calling per unit time of the first service interface;
the first service interface is any service interface in the micro service node.
5. The method of claim 4, wherein in the case that the external interface is called in the first service interface, calculating the maximum throttling threshold of the first service interface according to the average processing time per unit time, the interface reference response time, the number of times that the external interface is called per unit time, and the average time that the downstream service interface calls per unit time of the first service interface comprises:
under the condition that a calling external interface exists in a first service interface, calculating a maximum current limit threshold value of the first service interface according to a calculation formula L (a 1 cc (rt/pvt) (ncvt/pvt);
the calculating the maximum current limit threshold of the first service interface according to the average processing time per unit time, the interface reference response time and the number of times of being called per unit time of the first service interface when the external interface is not called by the first service interface includes:
under the condition that the first service interface does not have a calling external interface, calculating a maximum current limit threshold value of the first service interface according to a calculation formula L (a 1 cc (rt/pvt);
wherein, L represents the maximum current limit threshold, a1 represents a first preset value, cc represents the number of times of call in unit time, rt represents the interface reference response time, pvt represents the average processing time consumption in unit time, and ncvt represents the average time consumption of call of the downstream service interface in unit time.
6. The method according to claim 3, wherein the calculating the resource consumption value of each service interface according to the average usage time of the CPU per unit time, the average usage size of the memory per unit time, and the average network bandwidth consumption per unit time of each service interface comprises:
respectively calculating the resource consumption value of each service interface according to a calculation formula R ═ cvt × b1+ uvm × b2+ nvm × b 3;
wherein, R represents a resource consumption value, cvt represents an average usage time of the CPU in unit time, uvm represents an average value of memory usage in unit time, nvm represents network bandwidth consumption in unit time, b1 represents a second preset value, b2 represents a third preset value, and b3 represents a fourth preset value.
7. The method of claim 3, wherein before the calculating the current limiting threshold of each service interface of the micro service node according to the resource usage parameter and the capability parameter of each service interface, the method further comprises:
acquiring the service level of the micro service node and the interface level of each service interface in the micro service node;
calculating the interface weight of each service interface according to the service level of the micro service node and the interface level of each service interface in the micro service node;
the calculating the current limit threshold of each service interface according to the resource consumption value and the maximum current limit threshold of each service interface respectively includes:
and respectively calculating the current limiting threshold of each service interface according to the resource consumption value, the maximum current limiting threshold and the interface weight of each service interface.
8. The method of claim 7, wherein before the calculating the current limiting threshold of each service interface of the micro service node according to the resource usage parameter and the capability parameter of each service interface, the method further comprises:
acquiring resource use parameters of the micro service nodes, wherein the resource use parameters of the micro service nodes comprise at least one of the following items: CPU utilization rate, memory utilization rate and network bandwidth utilization rate;
calculating a current limiting weighted value according to the resource use parameters of the micro service nodes;
the calculating the current limit threshold of each service interface according to the resource consumption value, the maximum current limit threshold and the interface weight of each service interface respectively includes:
and respectively calculating the current limiting threshold of each service interface according to the current limiting weighted value, the resource consumption value of each service interface, the maximum current limiting threshold and the interface weight.
9. The method of claim 8, wherein calculating the current limit threshold for each service interface according to the current limit weighting value and the resource consumption value, the maximum current limit threshold, and the interface weight of each service interface comprises:
according to a calculation formula
Respectively calculating the current limiting threshold value of each service interface;
wherein S isiIndicating a current limit threshold, L, for an ith service interface in the microservice nodeiRepresenting a maximum current limit threshold, R, of an ith service interface in the microservice nodeiRepresenting a resource consumption value, W, of an ith service interface in the microservice nodeiAnd expressing the interface weight of the ith service interface in the micro service node, N expressing the number of the service interfaces in the micro service node, and P expressing the current limiting weight value.
10. The method of claim 8, wherein calculating a current limit weighting value based on the resource usage parameter of the micro service node comprises:
calculating a current limiting weighted value according to a calculation formula P ═ c1/max (cvp, mvp, nvp);
wherein P represents a current limit weight value, cvp represents a CPU utilization rate, mvp represents a memory utilization rate, nvp represents a network bandwidth utilization rate, and c1 represents a fifth preset value.
11. The method of claim 7, wherein calculating the interface weight of each service interface according to the service level of the micro service node and the interface level of each service interface in the micro service node comprises:
respectively calculating the interface weight of each service interface according to a calculation formula W (sl + d 1) il;
wherein W represents the interface weight, sl represents the service level, il represents the interface level, and d1 represents the sixth preset value.
12. A service interface flow control apparatus, comprising:
the first acquisition module is used for acquiring resource use parameters and capability parameters of each service interface of the micro service node;
the first calculation module is used for respectively calculating the current limiting threshold value of each service interface according to the resource use parameter and the capability parameter of each service interface of the micro service node;
and the flow control module is used for performing flow control on each service interface according to the flow limiting threshold value of each service interface.
13. A service interface flow control apparatus comprising a processor, a memory, and a computer program stored on the memory and executable on the processor, the computer program, when executed by the processor, implementing the steps of the service interface flow control method according to any one of claims 1 to 11.
14. A computer-readable storage medium, characterized in that the computer-readable storage medium has stored thereon a computer program which, when being executed by a processor, carries out the steps of the service interface flow control method according to any one of claims 1 to 11.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911094612.0A CN112783641A (en) | 2019-11-11 | 2019-11-11 | Service interface flow control method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911094612.0A CN112783641A (en) | 2019-11-11 | 2019-11-11 | Service interface flow control method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112783641A true CN112783641A (en) | 2021-05-11 |
Family
ID=75749678
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911094612.0A Pending CN112783641A (en) | 2019-11-11 | 2019-11-11 | Service interface flow control method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112783641A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114338639A (en) * | 2021-12-20 | 2022-04-12 | 上海万物新生环保科技集团有限公司 | Nginx flow limit early warning method and device |
| CN115242722A (en) * | 2022-06-14 | 2022-10-25 | 中盈优创资讯科技有限公司 | Advanced flow control implementation method based on API gateway |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110194411A1 (en) * | 2007-07-12 | 2011-08-11 | Cisco Technology, Inc. | Applying router quality of service on a cable modem interface on a per-service-flow basis |
| CN106411558A (en) * | 2015-07-27 | 2017-02-15 | 阿里巴巴集团控股有限公司 | Data flow limitation method and system |
| CN107153573A (en) * | 2016-03-02 | 2017-09-12 | 阿里巴巴集团控股有限公司 | Distributed task scheduling treating method and apparatus |
| CN107196785A (en) * | 2017-03-31 | 2017-09-22 | 北京奇艺世纪科技有限公司 | The method and device that back-end services degrade automatically |
| CN107222426A (en) * | 2016-03-21 | 2017-09-29 | 阿里巴巴集团控股有限公司 | The method of flow control, apparatus and system |
| CN107846295A (en) * | 2016-09-19 | 2018-03-27 | 华为技术有限公司 | Micro services configuration device and method |
| US20180121221A1 (en) * | 2016-10-28 | 2018-05-03 | ShieldX Networks, Inc. | Systems and methods for deploying microservices in a networked microservices system |
| CN108073465A (en) * | 2017-12-29 | 2018-05-25 | 中国平安人寿保险股份有限公司 | Dynamic current limiting method, Nginx servers, storage medium and device |
| CN108733493A (en) * | 2018-05-25 | 2018-11-02 | 北京车和家信息技术有限公司 | Computational methods, computing device and the computer readable storage medium of resource utilization |
| CN109522115A (en) * | 2018-10-11 | 2019-03-26 | 平安科技（深圳）有限公司 | Resource allocation method, electronic equipment and storage medium |
| CN109756364A (en) * | 2018-12-07 | 2019-05-14 | 成都四方伟业软件股份有限公司 | A kind of micro services performance optimization system and analysis method based on log analysis |
| CN109903175A (en) * | 2019-03-26 | 2019-06-18 | 众安在线财产保险股份有限公司 | A kind of Insurance core system monitor supervision platform |
| CN110399212A (en) * | 2018-04-25 | 2019-11-01 | 北京京东尚科信息技术有限公司 | Task requests processing method, device, electronic equipment and computer-readable medium |
-
2019
- 2019-11-11 CN CN201911094612.0A patent/CN112783641A/en active Pending
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110194411A1 (en) * | 2007-07-12 | 2011-08-11 | Cisco Technology, Inc. | Applying router quality of service on a cable modem interface on a per-service-flow basis |
| CN106411558A (en) * | 2015-07-27 | 2017-02-15 | 阿里巴巴集团控股有限公司 | Data flow limitation method and system |
| CN107153573A (en) * | 2016-03-02 | 2017-09-12 | 阿里巴巴集团控股有限公司 | Distributed task scheduling treating method and apparatus |
| CN107222426A (en) * | 2016-03-21 | 2017-09-29 | 阿里巴巴集团控股有限公司 | The method of flow control, apparatus and system |
| CN107846295A (en) * | 2016-09-19 | 2018-03-27 | 华为技术有限公司 | Micro services configuration device and method |
| US20180121221A1 (en) * | 2016-10-28 | 2018-05-03 | ShieldX Networks, Inc. | Systems and methods for deploying microservices in a networked microservices system |
| CN107196785A (en) * | 2017-03-31 | 2017-09-22 | 北京奇艺世纪科技有限公司 | The method and device that back-end services degrade automatically |
| CN108073465A (en) * | 2017-12-29 | 2018-05-25 | 中国平安人寿保险股份有限公司 | Dynamic current limiting method, Nginx servers, storage medium and device |
| CN110399212A (en) * | 2018-04-25 | 2019-11-01 | 北京京东尚科信息技术有限公司 | Task requests processing method, device, electronic equipment and computer-readable medium |
| CN108733493A (en) * | 2018-05-25 | 2018-11-02 | 北京车和家信息技术有限公司 | Computational methods, computing device and the computer readable storage medium of resource utilization |
| CN109522115A (en) * | 2018-10-11 | 2019-03-26 | 平安科技（深圳）有限公司 | Resource allocation method, electronic equipment and storage medium |
| CN109756364A (en) * | 2018-12-07 | 2019-05-14 | 成都四方伟业软件股份有限公司 | A kind of micro services performance optimization system and analysis method based on log analysis |
| CN109903175A (en) * | 2019-03-26 | 2019-06-18 | 众安在线财产保险股份有限公司 | A kind of Insurance core system monitor supervision platform |
Non-Patent Citations (2)
| Title |
|---|
| BAI W, ET AL: "Enabling {ECN} in multi-service multi-queue data centers", 13TH {USENIX} SYMPOSIUM ON NETWORKED SYSTEMS DESIGN AND IMPLEMENTATION, pages 537 - 549 * |
| 仲思惠: "基于令牌桶算法的流量控制服务的设计与实现", 大连理工大学, pages 1 - 65 * |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114338639A (en) * | 2021-12-20 | 2022-04-12 | 上海万物新生环保科技集团有限公司 | Nginx flow limit early warning method and device |
| CN115242722A (en) * | 2022-06-14 | 2022-10-25 | 中盈优创资讯科技有限公司 | Advanced flow control implementation method based on API gateway |
| CN115242722B (en) * | 2022-06-14 | 2024-04-16 | 中盈优创资讯科技有限公司 | Advanced flow control implementation method based on API gateway |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113037786B (en) | Intelligent computing power scheduling method, device and system | |
| CN111126594B (en) | Neural network model dynamic segmentation method and device based on edge calculation | |
| CN112868265B (en) | Network resource management method, management device, electronic equipment and storage medium | |
| CN111767142B (en) | Method for setting current limiting threshold of service node and service terminal equipment | |
| CN106713168B (en) | Flow control method and system | |
| CN112783641A (en) | Service interface flow control method and device | |
| KR102612312B1 (en) | Electronic apparatus and controlling method thereof | |
| CN113438681B (en) | Network slice feasibility evaluation method and device and computing equipment | |
| CN111147395A (en) | Network resource adjusting method and device | |
| CN114070791B (en) | Speed limiting processing method and device for data traffic | |
| CN107454136B (en) | Calculation unloading method and device based on end-to-end P2P and control equipment | |
| CN110113269B (en) | Flow control method based on middleware and related device | |
| US20240005940A1 (en) | Echo cancellation method and apparatus, device, and storage medium | |
| CN108345696A (en) | Card sort method, device, server and storage medium | |
| CN110347477B (en) | Service self-adaptive deployment method and device in cloud environment | |
| CN113050955A (en) | Self-adaptive AI model deployment method | |
| CN110190988B (en) | Service deployment method and device | |
| CN112001563A (en) | Method and device for managing phone bill amount, electronic equipment and storage medium | |
| CN114095444A (en) | Current limiting method and device and electronic equipment | |
| CN107102799A (en) | A kind of method and its intelligent terminal for adjusting the screen time of going out | |
| CN114466365B (en) | Spectrum resource acquisition method, spectrum resource acquisition device and computer readable storage medium | |
| CN113453285B (en) | Resource adjusting method, device and storage medium | |
| CN113867933B (en) | Edge computing application deployment method and device | |
| CN114936089A (en) | Resource scheduling method, system, device and storage medium | |
| CN115498735A (en) | Fuel cell monomer voltage monitoring method and fuel cell controller |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |