CN112615790A - Multi-server-side flow limiting and flow monitoring system and method - Google Patents
Multi-server-side flow limiting and flow monitoring system and method Download PDFInfo
- Publication number
- CN112615790A CN112615790A CN202011533088.5A CN202011533088A CN112615790A CN 112615790 A CN112615790 A CN 112615790A CN 202011533088 A CN202011533088 A CN 202011533088A CN 112615790 A CN112615790 A CN 112615790A
- Authority
- CN
- China
- Prior art keywords
- service
- current
- data
- configuration center
- qps
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 62
- 238000012544 monitoring process Methods 0.000 title claims abstract description 45
- 238000012545 processing Methods 0.000 claims abstract description 86
- 238000004148 unit process Methods 0.000 claims description 17
- 230000015556 catabolic process Effects 0.000 abstract description 5
- 238000006731 degradation reaction Methods 0.000 abstract description 5
- 230000004044 response Effects 0.000 abstract description 4
- 230000008569 process Effects 0.000 description 13
- 230000015654 memory Effects 0.000 description 11
- 238000004590 computer program Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 8
- 230000006870 function Effects 0.000 description 5
- 238000010295 mobile communication Methods 0.000 description 3
- 230000002159 abnormal effect Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 238000009530 blood pressure measurement Methods 0.000 description 2
- 238000012935 Averaging Methods 0.000 description 1
- 241000700189 Hystrix <Rodentia> Species 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000007123 defense Effects 0.000 description 1
- 230000000593 degrading effect Effects 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
- H04L41/0631—Management of faults, events, alarms or notifications using root cause analysis; using analysis of correlation between notifications, alarms or events based on decision criteria, e.g. hierarchy, tree or time analysis
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0876—Network utilisation, e.g. volume of load or congestion level
- H04L43/0894—Packet rate
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/16—Threshold monitoring
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Environmental & Geological Engineering (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The current limiting system of many servers includes: the system comprises a plurality of service terminals, a configuration center, an asynchronous queue, a service monitoring unit and a data processing unit. The service monitoring unit is configured at the configuration center and is capable of configuring qps the current limit threshold to the configuration center. The service monitoring unit can acquire the data traffic of the service interface. The configuration center judges whether to send the data of the current service interface to the asynchronous queue for shunting or to the data processing unit for processing according to the current data flow of the service interface and the set qps current-limiting threshold value. Therefore, the method is suitable for the use and implementation of the core service of the system with quick response, ensures the stability and high availability of the system when the service triggers the current limiting degradation, and can ensure the data not to be lost and the final consistency. And in the later stage, even multiple queues can be used for ensuring data synchronization, so that the expansibility is large. Meanwhile, the invention also provides a multi-server flow monitoring system and a multi-server flow limiting and monitoring method.
Description
Technical Field
The invention relates to the field of optimization and application of distributed systems. The invention particularly relates to a multi-server current limiting and flow monitoring system and method.
Background
There are many dependencies between distributed system services, and each will inevitably fail. If the core service is not isolated from other service failures, it is likely that they will be dragged down and the overall system will crash. In the prior art, a flow defense soldier of a Sentinel distributed system mainly takes flow as an entry point, and guarantees the stability of service from multiple dimensions such as flow control, fusing degradation, system load protection and hot point protection.
The delay and fault tolerant library of the Hystrix distributed system in the prior art provides protection and controls delay and failure to stop complex cascading failures for dependencies accessed through a third party client library (usually through a network). Can fail quickly and recover quickly. Rollback and, where possible, normal downgrade.
The above prior art provides similar current limiting, fusing, and degrading strategies to ensure the stability and availability of system services. In the prior art, the availability and stability of core services are ensured mainly by maintaining the stability of a system main body and discarding flow or sacrificing non-core services when necessary. But for core services, data cannot be lost or degraded, and these schemes are not fully applicable in situations like traffic surge.
These drawbacks are mainly due to the fact that the flow limitation, i.e. the denial of service, rejects redundant requests; fusing, namely, no longer requesting the abnormal dependent service, and requesting again when the service is recovered; downgrade, i.e., abandoning some non-essential functions, abandoning the car guard, etc.
Disclosure of Invention
The embodiment of the invention provides a multi-server current limiting and flow monitoring system and a method thereof, which are used for solving at least one of the technical problems.
In a first aspect, an embodiment of the present invention provides a multi-server current limiting system, which includes: the system comprises a plurality of service terminals, a configuration center, an asynchronous queue, a service monitoring unit and a data processing unit. Wherein,
a plurality of service terminals, each service of which has a service interface;
the configuration center can configure the service interfaces of a plurality of service terminals and is connected with one data processing unit;
an asynchronous queue configured at the configuration center;
a service monitoring unit configured at the configuration center and capable of configuring qps a current limit threshold to the configuration center; the service monitoring unit can acquire the data flow of the service interface;
the configuration center judges whether to send the data of the current service interface to the asynchronous queue for shunting or to the data processing unit for processing according to the current data flow of the service interface and a set qps current-limiting threshold;
the data processing unit processes the current data sent by the configuration center; or the data processing unit processes the current data sent by the configuration center and the asynchronous queue.
In a second aspect, an embodiment of the present invention provides a multi-server traffic monitoring system, which includes a multi-server current limiting system and an alarm system in the present invention;
and the alarm system is configured in the configuration center, and if the current data flow exceeds the set qps current limit threshold, an alarm output log is sent to the alarm system.
In a third aspect, an embodiment of the present invention provides a multi-server current limiting method, where the current limiting method is implemented by a multi-server current limiting system, and the multi-server current limiting system includes:
a plurality of service terminals, each service of which has a service interface;
the configuration center can configure the service interfaces of a plurality of service terminals and is connected with a data processing unit;
an asynchronous queue disposed at the configuration center;
a service monitoring unit configured at the configuration center and capable of configuring qps current limit thresholds to the configuration center; the service monitoring unit can acquire the data flow of the service interface; and
a data processing unit.
The current limiting method of the multiple service ends comprises the following steps:
step S101, the configuration center judges whether to send the data of the current service interface to the asynchronous queue for shunting or to the data processing unit for processing according to the current data flow of the service interface and a set qps current limiting threshold;
step S102, the data processing unit processes the current data sent by the configuration center; or the data processing unit processes the current data sent by the configuration center and the asynchronous queue.
In a fourth aspect, an embodiment of the present invention provides a method for monitoring multiple servers, where the method includes: the invention relates to a multi-service-end current limiting method, which also comprises the following steps:
if the current data flow exceeds the set qps current limit threshold, an alarm output log is sent outwards; the alarm output log includes: the method comprises the following steps of applying a service name, an interface belonging class name, an interface method name, an interface routing address and current limiting occurrence time.
In a fifth aspect, an electronic device for efficient offline semantic parsing is provided, which includes: the apparatus includes at least one processor, and a memory communicatively coupled to the at least one processor, wherein the memory stores instructions executable by the at least one processor to cause the at least one processor to perform the steps of the method of any of the embodiments of the present invention.
In a sixth aspect, the embodiments of the present invention also provide a computer program product, the computer program product comprising a computer program stored on a non-volatile computer-readable storage medium, the computer program comprising program instructions which, when executed by a computer, cause the computer to perform the steps of the method of any of the embodiments of the present invention.
The invention monitors qps current-limiting threshold values of each service interface by setting the service monitoring unit, and when the qps current-limiting threshold value exceeds the preset value, the excess part is shunted to the asynchronous queue in time, so that the invention is suitable for the use and implementation of the core service of the system with quick response, ensures the stability and high availability of the system when the service triggers the current-limiting degradation, and simultaneously can ensure the data not to be lost and the final consistency. The cost consumption caused by manual intervention, blind hardware stacking and the like is reduced. And in the later stage, even multiple queues can be used for ensuring data synchronization, so that the expansibility is large.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.
Fig. 1 is a block diagram of a multi-server current limiting system according to an embodiment of the present invention;
fig. 2 is a block diagram of a multi-server current limiting system according to another embodiment of the present invention;
FIG. 3 is a block diagram of a multi-server current limiting system according to another embodiment of the present invention;
fig. 4 is a flowchart illustrating a multi-server current limiting method according to an embodiment of the present invention;
FIG. 5 is a flowchart illustrating a multi-server current limiting method according to another embodiment of the present invention
FIG. 6 is a schematic configuration flow diagram according to an embodiment of the present invention;
FIG. 7 is a flow diagram illustrating a flow of a current limited asynchronous queue process according to an embodiment of the present invention;
FIG. 8 is a schematic diagram of an alarm output process according to an embodiment of the present invention;
fig. 9 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the technical solutions of the embodiments of the present invention will be described clearly and completely with reference to the accompanying drawings of the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be obtained by a person skilled in the art without any inventive step based on the embodiments of the present invention, are within the scope of the present invention.
The inventor finds that in the process of implementing the present application, a hardware stacking manner is usually adopted, and service nodes are added to ensure the availability and stability of core services in quantity, but the cost is increased correspondingly; the monitoring strength is increased, manual intervention is performed, processing is relatively delayed, and system adaptability is lacked. Due to the combination of the system framework and the use scenes of different services, the system service is required to be processed asynchronously, return quickly and be suitable for the scheme when relative compensation measures exist.
The present invention presets qps alarm thresholds for the emphasis interface by analyzing the qps values of the service. When abnormal conditions such as rapid traffic increase occur and the interface reaches the performance bottleneck, the rejected traffic is led into a queue (in the scheme, the RocktMQ is adopted) through a current limiting measure, the led-in traffic is asynchronously consumed according to the transaction consistency and high availability of the RocktMQ, and the data can be timely processed under the condition of ensuring that the data is not lost. Meanwhile, the alarm information is sent out, service nodes are added according to the situation through human intervention, the alarm threshold value can be dynamically adjusted qps in real time, and the system performance is recovered.
In a first aspect, as shown in fig. 1, an embodiment of the present invention provides a multi-server current limiting system 101, which includes: a plurality of servers 10, 11, 12, 13, a configuration center 20, an asynchronous queue 30, a service monitoring unit 40 and a data processing unit 50. Wherein:
a plurality of servers 10, 11, 12, 13 each having a service interface.
A configuration center 20, which can configure the service interfaces of a plurality of service terminals 10, 11, 12, 13 and is connected with a data processing unit 50.
And an asynchronous queue 30 disposed at the configuration center 20.
A service monitoring unit 40, which is configured at the configuration center 20 and is capable of configuring qps the current limit threshold to the configuration center 20. The service monitoring unit 40 can obtain the data traffic of the service interface.
The configuration center 20 determines whether to send the data of the current service interface to the asynchronous queue 30 for shunting or send the data to the data processing unit 50 for processing according to the current data traffic of the service interface and the set qps current limit threshold.
The data processing unit 50 processes the current data sent by the configuration center 20, or the data processing unit 50 processes the current data sent by the configuration center 20 and the asynchronous queue 30.
In a preferred embodiment of the multi-service current limiting system of the present invention, the configuration center 20 is specifically configured to:
as shown in fig. 2, if the configuration center 20 determines that the current data traffic of the service interface exceeds the set qps flow limit threshold, the configuration center sends the excess traffic data that the current data traffic exceeds qps flow limit threshold to the asynchronous queue 30 for processing. The asynchronous queue 30 shunts excess traffic data for transmission to the data processing unit 50. The configuration center 20 sends current data of the service interface equivalent to qps current limit threshold to the data processing unit 50.
The data processing unit 50 is configured to: the service interface data sent from the configuration center 20 and the asynchronous queue 30 is processed.
In another preferred embodiment of the multi-service current limiting system of the present invention, the configuration center 20 is specifically configured to:
if the configuration center 20 determines that the current data traffic of the service interface does not exceed the set qps throttling threshold, it sends the current data to the data processing unit 50.
The data processing unit 50 is configured to: the data processing unit 50 processes data transmitted from the configuration center 20.
In another preferred embodiment of the multi-service throttling system of the present invention, the service monitoring unit 40 obtains the data traffic of the service interface through qps service monitoring tool.
The service monitoring unit 40 is specifically configured to: through qps service monitoring tool, qps mean values of service interface peak periods are obtained. And obtaining qps a current limit threshold according to qps the mean value multiplied by a set sudden increase coefficient.
In another preferred embodiment of the multi-service current limiting system of the present invention, the set burst factor is obtained by dividing the average value of the set number qps peak values in the flat period by the qps average value and then adding the floating factor. The floating coefficients are incrementally fixed values for a plurality of levels of settings.
The invention monitors qps current-limiting threshold values of each service interface by setting the service monitoring unit, and when the qps current-limiting threshold value exceeds the preset value, the excess part is shunted to the asynchronous queue in time, so that the invention is suitable for the use and implementation of the core service of the system with quick response, ensures the stability and high availability of the system when the service triggers the current-limiting degradation, and simultaneously can ensure the data not to be lost and the final consistency. The cost consumption caused by manual intervention, blind hardware stacking and the like is reduced. And in the later stage, even multiple queues can be used for ensuring data synchronization, so that the expansibility is large.
In a second aspect, as shown in fig. 3, a multi-service traffic monitoring system is provided in an embodiment of the present invention, which includes a multi-service flow limiting system 101 and an alarm system 201 in any embodiment of the present invention.
The alarm system 201 is configured at the configuration center 20, and if the current data traffic exceeds the set qps flow limit threshold, an alarm output log is sent to the alarm system 201.
In a preferred embodiment of the flow monitoring system of the present invention, the alarm output log comprises: the method comprises the following steps of applying a service name, an interface belonging class name, an interface method name, an interface routing address and current limiting occurrence time.
In a third aspect, an embodiment of the present invention provides a multi-server current limiting method, where the current limiting method is implemented by a multi-server current limiting system, and as shown in fig. 1, the multi-server current limiting system includes:
a plurality of servers 10, 11, 12, 13 each having a service interface.
A configuration center 20, which can configure the service interfaces of multiple service terminals 10, 11, 12, 13 and is connected to a data processing unit 50.
An asynchronous queue 30 is disposed at the configuration center 20.
A service monitoring unit 40, which is configured at the configuration center 20 and is capable of configuring qps the current limit threshold to the configuration center 20. The service monitoring unit 40 can obtain the data traffic of the service interface.
And
a data processing unit 50.
As shown in fig. 4, the method for limiting the current of multiple servers includes:
and step S101, judging the current data flow.
In this step, the configuration center 20 determines whether to send the data of the current service interface to the asynchronous queue 30 for shunting or to the data processing unit 50 for processing according to the current data traffic of the service interface and the set qps current limit threshold.
In step S102, the data processing unit processes the current data.
In this step, the data processing unit 50 processes the current data sent by the configuration center 20. Or the data processing unit 50 processes the current data sent by the configuration center 20 and the asynchronous queue 30.
In another preferred embodiment of the current limiter served in the present invention, as shown in fig. 5, step S101 includes:
s1011, current limit threshold determination is performed by qps.
In this step, if the configuration center 20 determines that the current data traffic of the service interface exceeds the set qps current limit threshold, the excess traffic data whose current data traffic exceeds qps current limit threshold is sent to the asynchronous queue 30 for processing. The asynchronous queue 30 shunts excess traffic data for transmission to the data processing unit 50. The configuration center 20 sends current data of the service interface equivalent to qps current limit threshold to the data processing unit 50.
Step S102 includes:
in step S1021, the data processing unit processes the service interface data.
In this step, the data processing unit 50 processes the service interface data transmitted from the configuration center 20 and the asynchronous queue 30.
In another preferred embodiment of the current limiter of the present invention, step S101 includes:
in step S1012, if the configuration center 20 determines that the current data traffic of the service interface does not exceed the set qps current limit threshold, it sends the current data to the data processing unit 50.
Step S102 includes: in step S1022, the data processing unit 50 processes the data transmitted from the configuration center 20.
In a fourth aspect, an embodiment of the present invention provides a method for monitoring multiple servers, where the method includes: the method for limiting the current of the multiple service ends in any embodiment of the invention further comprises the following steps:
and if the current data flow exceeds the set qps flow limit threshold, sending an alarm output log outwards. The alarm output log includes: the method comprises the following steps of applying a service name, an interface belonging class name, an interface method name, an interface routing address and current limiting occurrence time.
In another embodiment of the present invention, a method for limiting current of multiple servers is provided,
the invention is composed of three links of qps threshold value configuration, asynchronous queue processing of current limit and alarm output.
Configuration qps thresholds: analyzing qps value under normal condition of the service interface and the maximum qps value obtained by pressure measurement and the like,
and presetting an interface current limiting alarm threshold.
And (3) processing a current-limiting asynchronous queue: when the flow limitation occurs, the data of the part with suddenly increased flow is output to the queue to play a role of peak clipping and delay the processing of the data.
And (4) alarm output: when the abnormity happens, related personnel are informed, the system is monitored in time, and the high availability and the stability of the system are further ensured.
Each link is explained in detail as follows:
one, configure qps threshold
As shown in fig. 6, the configuration flow is as follows:
1.1, analyzing qps threshold values through a service monitoring tool such as grafana and the like, and configuring the service to a configuration center;
the threshold analysis mode is as follows: taking a single service single interface as an example, the average value of the interface peak-balancing period qps is obtained through a real-time operation and maintenance monitoring tool, and then multiplied by a sudden increase coefficient to obtain a threshold value. Reaching or exceeding this value means that the interface traffic is considered to have a sudden trend.
The sudden increase coefficient is: dividing the average value of n qps peak values in the peak-averaging period by the average value of qps, and adding a floating coefficient; floating coefficient: a predetermined fixed value for each of a plurality of levels. And selecting a corresponding coefficient of a corresponding level according to the ratio of the maximum qps value obtained by interface pressure measurement to the average value of the peak values of the peak-off period qps.
1.2, qps threshold value of the configuration center can be modified in real time, and the modified threshold value is synchronized to the current limiting threshold value of the corresponding interface of the application service, so that the effect of dynamically adjusting the current limiting strategy is achieved.
Second, current limited asynchronous queue processing
As shown in fig. 7, the current-limited asynchronous queue process is as follows:
2.1, normal, i.e. not reaching qps the current limit threshold, the requested data is processed directly.
2.2, when current limiting is triggered, namely the current limiting exceeds a configured qps current limiting threshold, exceeding part of data enters an asynchronous queue, and shunting is realized by utilizing the characteristics of queue message distribution, high throughput and the like;
2.3 the data processor (of the same service or other services) will read and process the data in the asynchronous queue, achieving no data loss and final consistency.
Third, alarm output
As shown in fig. 8, the alarm output process is as follows:
and 3.1, outputting the log to an alarm system when the service is subjected to current limiting. The log content comprises the name of the application service, the name of the class to which the interface belongs, the name of the interface method, the interface routing address and the current limiting occurrence time.
And 3.2, sending an alarm notice by an alarm system and carrying out artificial intervention treatment.
The terms in this patent are to be interpreted as:
qps: quieries-per-second, a measure of how much traffic a particular query server is processing within a specified time.
In other embodiments, the present invention further provides a non-volatile computer storage medium, where the computer storage medium stores computer-executable instructions, where the computer-executable instructions may perform the multi-server current limiting method in any of the above method embodiments;
as one embodiment, a non-transitory computer storage medium of the present invention stores computer-executable instructions, and a computer-executable method is configured to:
and step S101, judging whether to send the data of the current service interface to an asynchronous queue for shunting or to the data processing unit for processing according to the current data flow of the service interface and a set qps current limit threshold.
Step S102, the data processing unit processes the current data sent by the configuration center. Or the data processing unit processes the current data sent by the configuration center and the asynchronous queue.
The invention monitors qps current-limiting threshold values of each service interface by setting the service monitoring unit, and when the qps current-limiting threshold value exceeds the preset value, the excess part is shunted to the asynchronous queue in time, so that the invention is suitable for the use and implementation of the core service of the system with quick response, ensures the stability and high availability of the system when the service triggers the current-limiting degradation, and simultaneously can ensure the data not to be lost and the final consistency. The cost consumption caused by manual intervention, blind hardware stacking and the like is reduced. And in the later stage, even multiple queues can be used for ensuring data synchronization, so that the expansibility is large.
The non-volatile computer-readable storage medium may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to use of the multi-server current limiting processing device, and the like. Further, the non-volatile computer-readable storage medium may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some embodiments, the non-transitory computer readable storage medium optionally includes memory remotely located from the processor, and these remote memories may be connected to the multi-server current limiting processing device over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
Embodiments of the present invention further provide a computer program product, where the computer program product includes a computer program stored on a non-volatile computer-readable storage medium, and the computer program includes program instructions, which, when executed by a computer, cause the computer to execute any one of the above methods for limiting current of multiple servers.
Fig. 9 is a schematic structural diagram of an electronic device according to an embodiment of the present invention, and as shown in fig. 9, the electronic device includes: one or more processors 910 and a memory 920, one processor 910 being illustrated in fig. 9. The device of the multi-server current limiting method may further include: an input device 930 and an output device 940. The processor 910, the memory 920, the input device 930, and the output device 940 may be connected by a bus or other means, and fig. 9 illustrates an example of a connection by a bus. The memory 920 is a non-volatile computer-readable storage medium as described above. The processor 910 executes various functional applications and data processing of the server by running the nonvolatile software programs, instructions and modules stored in the memory 920, that is, the method for limiting current of multiple servers according to the above embodiment is implemented. The input device 930 may receive input numeric or character information and generate key signal inputs related to user settings and function controls of the information delivery device. The output device 940 may include a display device such as a display screen.
The product can execute the method provided by the embodiment of the invention, and has corresponding functional modules and beneficial effects of the execution method. For technical details that are not described in detail in this embodiment, reference may be made to the method provided by the embodiment of the present invention.
As an embodiment, the electronic device may be applied to an encryption and decryption platform, and includes: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to enable the at least one configuration center to:
and step S101, the configuration center judges whether to send the data of the current service interface to the asynchronous queue for shunting or to the data processing unit for processing according to the current data flow of the service interface and a set qps current limiting threshold.
Step S102, the data processing unit processes the current data sent by the configuration center; or the data processing unit processes the current data sent by the configuration center and the asynchronous queue.
The electronic device of the embodiments of the present application exists in various forms, including but not limited to:
(1) a mobile communication device: such devices are characterized by mobile communications capabilities and are primarily targeted at providing voice, data communications. Such terminals include smart phones, multimedia phones, functional phones, and low-end phones, among others.
(2) Ultra mobile personal computer device: the equipment belongs to the category of personal computers, has calculation and processing functions and generally has the characteristic of mobile internet access. Such terminals include: PDA, MID, and UMPC devices, etc.
(3) A portable entertainment device: such devices can display and play multimedia content. The devices comprise audio and video players, handheld game consoles, electronic books, intelligent toys and portable vehicle-mounted navigation devices.
(4) The server is similar to a general computer architecture, but has higher requirements on processing capability, stability, reliability, safety, expandability, manageability and the like because of the need of providing highly reliable services.
(5) And other electronic devices with data interaction functions.
The above-described embodiments of the apparatus are merely schematic, where units illustrated as separate components may or may not be physically separate, and components shown as units may or may not be physical units, may be located in one place, or may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding, the above technical solutions may be embodied in the form of a software product, which may be stored in a computer-readable storage medium, such as ROM/RAM, magnetic disk, optical disk, etc., and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods of the embodiments or some parts of the embodiments.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solutions of the present invention, and not for limiting the same; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may be modified or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (10)
1. A multi-service current limiting system, comprising:
a plurality of service terminals, each service of which has a service interface;
the configuration center can configure the service interfaces of a plurality of service terminals and is connected with a data processing unit;
an asynchronous queue disposed at the configuration center;
a service monitoring unit configured at the configuration center and capable of configuring qps current limit thresholds to the configuration center; the service monitoring unit can acquire the data flow of the service interface;
the configuration center judges whether to send the data of the current service interface to the asynchronous queue for shunting or to the data processing unit for processing according to the current data flow of the service interface and a set qps current-limiting threshold;
the data processing unit processes the current data sent by the configuration center; or the data processing unit processes the current data sent by the configuration center and the asynchronous queue.
2. The flow limiting system of claim 1, wherein the configuration center is specifically configured to:
if the configuration center judges that the current data flow of the service interface exceeds a set qps current limit threshold, sending the data of the exceeding flow, the current data flow of which exceeds the qps current limit threshold, to an asynchronous queue for processing; the asynchronous queue shunts the excess flow data and then sends the excess flow data to the data processing unit; the configuration center sends the current data of the service interface equivalent to the qps current limit threshold value to a data processing unit;
the data processing unit is configured to: processing service interface data sent from the configuration center and the asynchronous queue.
3. The flow limiting system of claim 1, wherein the configuration center is specifically configured to:
if the configuration center judges that the current data flow of the service interface does not exceed a set qps current limit threshold, the configuration center sends the current data to the data processing unit;
the data processing unit is configured to: the data processing unit processes data transmitted from the configuration center.
4. The flow limiting system of claim 1,
the service monitoring unit acquires the data traffic of the service interface through qps service monitoring tools;
the service monitoring unit is specifically configured to: obtaining, by the qps service monitoring tool, qps means of the service interface peak period; and obtaining qps a current limit threshold according to the qps mean value multiplied by a set sudden increase coefficient.
5. The flow limiting system of claim 4, wherein the set overshoot factor is obtained by dividing an average of a set number of peak values qps in a flat period by a mean value of qps, and then adding a floating factor; the floating coefficients are incrementally fixed values for a plurality of levels of settings.
6. A multi-server traffic monitoring system comprising a multi-server flow limiting system according to any one of claims 1 to 5 and an alarm system;
and the alarm system is configured in the configuration center, and if the current data flow exceeds the set qps current limit threshold, an alarm output log is sent to the alarm system.
7. The monitoring system of claim 6, wherein the alarm output log comprises: the method comprises the following steps of applying a service name, an interface belonging class name, an interface method name, an interface routing address and current limiting occurrence time.
8. A multi-service-end current limiting method is realized by a multi-service-end current limiting system, and the multi-service-end current limiting system comprises:
a plurality of service terminals, each service of which has a service interface;
the configuration center can configure the service interfaces of a plurality of service terminals and is connected with a data processing unit;
an asynchronous queue disposed at the configuration center;
a service monitoring unit configured at the configuration center and capable of configuring qps current limit thresholds to the configuration center; the service monitoring unit can acquire the data flow of the service interface; and
a data processing unit;
the current limiting method of the multiple service ends comprises the following steps:
step S101, the configuration center judges whether to send the data of the current service interface to the asynchronous queue for shunting or to the data processing unit for processing according to the current data flow of the service interface and a set qps current limiting threshold;
step S102, the data processing unit processes the current data sent by the configuration center; or the data processing unit processes the current data sent by the configuration center and the asynchronous queue.
9. The current limiting method according to claim 8, wherein the step S101 includes:
s1011, if the configuration center judges that the current data flow of the service interface exceeds the set qps current limit threshold, sending the excess flow data of which the current data flow exceeds the qps current limit threshold to an asynchronous queue for processing; the asynchronous queue shunts the excess flow data and then sends the excess flow data to the data processing unit; the configuration center sends the current data of the service interface equivalent to the qps current limit threshold value to a data processing unit;
the step S102 includes:
step S1021, the data processing unit processes the service interface data sent from the configuration center and the asynchronous queue;
the step S101 includes:
step S1012, if the configuration center determines that the current data traffic of the service interface does not exceed the set qps current limit threshold, sending the current data to the data processing unit;
the step S102 includes:
step S1022, the data processing unit processes the data transmitted from the configuration center.
10. A multi-server monitoring method, comprising: a multi-server current limiting method according to any of claims 8-9 and further comprising:
if the current data flow exceeds the set qps current limit threshold, an alarm output log is sent outwards; the alarm output log includes: the method comprises the following steps of applying a service name, an interface belonging class name, an interface method name, an interface routing address and current limiting occurrence time.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011533088.5A CN112615790A (en) | 2020-12-22 | 2020-12-22 | Multi-server-side flow limiting and flow monitoring system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011533088.5A CN112615790A (en) | 2020-12-22 | 2020-12-22 | Multi-server-side flow limiting and flow monitoring system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112615790A true CN112615790A (en) | 2021-04-06 |
Family
ID=75244186
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011533088.5A Pending CN112615790A (en) | 2020-12-22 | 2020-12-22 | Multi-server-side flow limiting and flow monitoring system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112615790A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113328906A (en) * | 2021-04-22 | 2021-08-31 | 成都欧珀通信科技有限公司 | Flow real-time monitoring method and device, storage medium and electronic equipment |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108920283A (en) * | 2018-08-06 | 2018-11-30 | 成都知道创宇信息技术有限公司 | Server guard method based on Prometheus performance monitoring system |
| CN109067597A (en) * | 2018-09-21 | 2018-12-21 | 杭州安恒信息技术股份有限公司 | A kind of distributed system dynamic and intelligent service administering method |
-
2020
- 2020-12-22 CN CN202011533088.5A patent/CN112615790A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108920283A (en) * | 2018-08-06 | 2018-11-30 | 成都知道创宇信息技术有限公司 | Server guard method based on Prometheus performance monitoring system |
| CN109067597A (en) * | 2018-09-21 | 2018-12-21 | 杭州安恒信息技术股份有限公司 | A kind of distributed system dynamic and intelligent service administering method |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113328906A (en) * | 2021-04-22 | 2021-08-31 | 成都欧珀通信科技有限公司 | Flow real-time monitoring method and device, storage medium and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10594606B2 (en) | Wired data-connection aggregation | |
| US9806960B2 (en) | Method and system for adjusting heavy traffic loads between personal electronic devices and external services | |
| EP3264723B1 (en) | Method, related apparatus and system for processing service request | |
| US7287082B1 (en) | System using idle connection metric indicating a value based on connection characteristic for performing connection drop sequence | |
| JP7442466B2 (en) | Data verification methods and devices, and storage media | |
| CN112671928B (en) | Equipment centralized management architecture, load balancing method, electronic equipment and storage medium | |
| US10560371B2 (en) | Method, apparatus, terminal device, and system for adjusting working status of aggregated link | |
| CN105847377A (en) | Cluster network's request congestion and overload processing method and system | |
| CN111641563A (en) | Flow self-adaption method and system based on distributed scene | |
| CN114448896B (en) | Network optimization method and device | |
| CN112615790A (en) | Multi-server-side flow limiting and flow monitoring system and method | |
| CN108551571B (en) | Monitoring video distribution method, device and system and distribution server | |
| CN113645233B (en) | Wind control intelligent decision method and device for flow data, electronic equipment and medium | |
| CN106878117B (en) | Data processing method and device | |
| CN100370770C (en) | Method for implementing long connection changeover of network | |
| CN114615337A (en) | Equipment scheduling method, system, server and storage medium | |
| CN110865895B (en) | Access flow control method, device, electronic equipment and storage medium | |
| CN113225265A (en) | Flow control method, device, equipment and computer storage medium | |
| CN112910799A (en) | Network data processing method, system, medium and equipment | |
| CN100583845C (en) | Method for assigning a number of m data links located on the subscriber side to a number of n data links located on the transport side | |
| CN114448987B (en) | Load decentralized management method, device, equipment and medium based on cloud service | |
| CN114070803B (en) | Data stream transmission method and device, storage medium and electronic device | |
| CN117202117B (en) | System and method for fusing and degrading short message channel | |
| CN116886553A (en) | Data transmission monitoring method and device, electronic equipment and readable storage medium | |
| CN108363551A (en) | A kind of storage system copy link flow control realizing method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 215123 building 14, Tengfei Innovation Park, 388 Xinping street, Suzhou Industrial Park, Suzhou City, Jiangsu Province Applicant after: Sipic Technology Co.,Ltd. Address before: 215123 building 14, Tengfei Innovation Park, 388 Xinping street, Suzhou Industrial Park, Suzhou City, Jiangsu Province Applicant before: AI SPEECH Co.,Ltd. |
|
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210406 |