CN117294652A - Flow control method, server, electronic device, and computer-readable storage medium - Google Patents
Flow control method, server, electronic device, and computer-readable storage medium Download PDFInfo
- Publication number
- CN117294652A CN117294652A CN202210678901.0A CN202210678901A CN117294652A CN 117294652 A CN117294652 A CN 117294652A CN 202210678901 A CN202210678901 A CN 202210678901A CN 117294652 A CN117294652 A CN 117294652A
- Authority
- CN
- China
- Prior art keywords
- service system
- target service
- time
- information
- access
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 118
- 230000036541 health Effects 0.000 claims abstract description 273
- 238000011217 control strategy Methods 0.000 claims abstract description 68
- 230000004044 response Effects 0.000 claims abstract description 61
- 238000012545 processing Methods 0.000 claims description 95
- 238000004364 calculation method Methods 0.000 claims description 27
- 238000012423 maintenance Methods 0.000 claims description 25
- 238000011084 recovery Methods 0.000 claims description 8
- 239000000523 sample Substances 0.000 claims description 7
- 238000004590 computer program Methods 0.000 claims description 5
- 230000000977 initiatory effect Effects 0.000 claims description 4
- 238000005516 engineering process Methods 0.000 abstract description 8
- 230000008569 process Effects 0.000 description 46
- 230000006870 function Effects 0.000 description 12
- 238000013500 data storage Methods 0.000 description 10
- 238000010586 diagram Methods 0.000 description 9
- 238000007726 management method Methods 0.000 description 7
- 230000008859 change Effects 0.000 description 5
- 238000004891 communication Methods 0.000 description 5
- 238000001514 detection method Methods 0.000 description 5
- 238000013507 mapping Methods 0.000 description 5
- 230000007246 mechanism Effects 0.000 description 5
- 230000026676 system process Effects 0.000 description 5
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 5
- 230000000694 effects Effects 0.000 description 4
- 230000005611 electricity Effects 0.000 description 4
- 238000007711 solidification Methods 0.000 description 4
- 230000008023 solidification Effects 0.000 description 4
- 238000011161 development Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000006467 substitution reaction Methods 0.000 description 3
- 238000012360 testing method Methods 0.000 description 3
- 238000012546 transfer Methods 0.000 description 3
- 238000003491 array Methods 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000009472 formulation Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 239000000203 mixture Substances 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- KDYFGRWQOYBRFD-UHFFFAOYSA-N succinic acid Chemical compound OC(=O)CCC(O)=O KDYFGRWQOYBRFD-UHFFFAOYSA-N 0.000 description 2
- 239000002699 waste material Substances 0.000 description 2
- RWSOTUBLDIXVET-UHFFFAOYSA-N Dihydrogen sulfide Chemical compound S RWSOTUBLDIXVET-UHFFFAOYSA-N 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- FFBHFFJDDLITSX-UHFFFAOYSA-N benzyl N-[2-hydroxy-4-(3-oxomorpholin-4-yl)phenyl]carbamate Chemical compound OC1=C(NC(=O)OCC2=CC=CC=C2)C=CC(=C1)N1CCOCC1=O FFBHFFJDDLITSX-UHFFFAOYSA-N 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000009194 climbing Effects 0.000 description 1
- 230000001427 coherent effect Effects 0.000 description 1
- 239000012141 concentrate Substances 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- -1 electricity Substances 0.000 description 1
- 239000002737 fuel gas Substances 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000005192 partition Methods 0.000 description 1
- 238000013139 quantization Methods 0.000 description 1
- 230000008439 repair process Effects 0.000 description 1
- 238000010200 validation analysis Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
- H04L47/24—Traffic characterised by specific attributes, e.g. priority or QoS
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
- H04L47/24—Traffic characterised by specific attributes, e.g. priority or QoS
- H04L47/2416—Real-time traffic
Abstract
The invention discloses a flow control method, a server, electronic equipment and a computer readable storage medium, wherein, each time a preset duration passes, historical access condition information of a target service system is obtained; according to the historical access condition information, determining independent health degree information of the target service system in a plurality of different time dimensions, and determining comprehensive health degree information of the target service system according to each independent health degree information; determining a real-time flow control strategy of a target service system according to the comprehensive health degree information; and controlling the flow of the target access request according to the real-time flow control strategy. The method and the system combine comprehensive response levels of the target service system in different time dimensions to determine the real-time flow control strategy, improve the accuracy of the strategy, and have higher efficiency and instantaneity of the dynamic flow control method. The invention can be widely applied to flow control technology of devices such as smart phones, tablet computers, notebook computers, desktop computers, servers, vehicle-mounted terminals and the like.
Description
Technical Field
The invention relates to the technical field of Internet, in particular to a flow control method, a server, electronic equipment and a computer readable storage medium.
Background
With the development of internet technology, more and more objects access a service system through the internet to transact a desired service, where the service system may be, for example, a service system of a banking institution, an online ticket purchasing system, a payment system of a payment institution, and so on. For example, the object may initiate a service request such as payment settlement, deposit or withdrawal to a service system of a banking institution via the internet.
Since the capability of the business system to handle the amount of access to the objects is limited by hardware performance, the normal operation of the business system may be affected when a large number of objects access the business system at the same time. In order to prevent the situation that the service system cannot work normally due to the fact that a large number of objects access the service system, the flow of the service system is controlled in a solidification flow control mode, namely, the upper limit of the access quantity of the service system is fixed, and when the real-time access quantity exceeds the upper limit, flow limiting processing is carried out. However, with the improvement of the hardware performance of various kinds of internet, each service system is continuously upgraded, so that the throughput of the service system can be improved, if the new performance of the service system after upgrading or optimizing cannot be fully exerted according to the existing solidification flow control mode, resource waste is caused, unless the upper limit of the access amount of each service system is manually reconfigured, obviously, the mode has low efficiency and poor real-time performance, and cannot adapt to the updating iteration speed of the current internet technology.
Disclosure of Invention
In view of the above, embodiments of the present invention provide a flow control method, a server, an electronic device, and a computer readable storage medium, which can implement efficient and real-time accurate dynamic control of access flow of a service system.
An aspect of an embodiment of the present invention provides a flow control method, including:
acquiring historical access condition information of a target service system every time a preset time length passes; the historical access condition information is used for representing the flow condition of the accessed target service system;
according to the historical access condition information, independent health degree information of the target service system in a plurality of different time dimensions is determined, and comprehensive health degree information of the target service system is determined according to each independent health degree information; each piece of independent health degree information is used for representing the response level of the target service system in a corresponding time dimension, and the comprehensive health degree information is used for representing the comprehensive response level of the target service system; the influence degree of the independent health degree information under different time dimensions on the determination of the comprehensive health degree information is different;
determining a real-time flow control strategy of the target service system according to the comprehensive health degree information;
And controlling the flow of the target access request according to the real-time flow control strategy.
Another aspect of an embodiment of the present invention provides a server, including:
the first module is used for acquiring historical access condition information of the target service system every time a preset time length passes; the historical access condition information is used for representing the flow condition of the accessed target service system;
the second module is used for determining independent health degree information of the target service system under a plurality of different time dimensions according to the historical access condition information, and determining comprehensive health degree information of the target service system according to each independent health degree information; each piece of independent health degree information is used for representing the response level of the target service system in a corresponding time dimension, and the comprehensive health degree information is used for representing the comprehensive response level of the target service system; the influence degree of the independent health degree information under different time dimensions on the determination of the comprehensive health degree information is different;
a third module, configured to determine a real-time flow control policy of the target service system according to the integrated health information;
And a fourth module, configured to perform flow control on the target access request according to the real-time flow control policy.
Optionally, the first module comprises at least one of:
a first unit, configured to obtain initiation time information of an access request of the target service system in a historical time period;
a second unit, configured to obtain time-consuming information of an access request of the target service system in a historical time period;
a third unit, configured to obtain access success/failure information of an access request of the target service system in a historical time period;
a fourth unit, configured to obtain object information of an access request of the target service system in a historical time period, where the object information includes an identifier of a service system to be requested and an identifier of a current access request;
and a fifth unit, configured to obtain the total number of access requests for the target service system in the history period.
Optionally, the second module includes:
a sixth unit, configured to calculate average time-consuming information of the target service system and unit time statistics information of the target service system in different time dimensions according to the historical access condition information;
a seventh unit, configured to calculate, according to the average time-consuming information and the unit time statistics information in the different time dimensions, independent health degree information in each time dimension;
And an eighth unit, configured to calculate the integrated health degree information according to the independent health degree information in each time dimension.
Optionally, the sixth unit includes:
a ninth unit, configured to calculate a total request amount of the target service system in a unit time according to a total number of access requests of the target service system in the historical time period;
a tenth unit, configured to calculate a successful request amount of the target service system in a unit time according to access success/failure information of the access request of the target service system in the historical time period;
an eleventh unit, configured to calculate average time consumption of the target service system in a unit time according to time consumption information of an access request for the target service system in the historical time period;
and a twelfth unit, configured to calculate a duty ratio coefficient of the successful request amount according to the total request amount of the target service system in unit time and the successful request amount of the target service system in unit time.
Optionally, the seventh unit includes:
and a thirteenth unit, configured to calculate, according to the average time consumption information of the target service system under the historical access condition and the total request amount of the target service system in unit time, the successful request amount in unit time, the average time consumption in unit time, and the duty ratio coefficient of the successful request amount, obtain independent health degree information in each time dimension.
Optionally, the eighth unit includes:
a fourteenth unit, configured to configure a weight threshold of the independent health degree information in each time dimension; the weight threshold value of the independent health degree information is used for representing the influence degree of the current independent health degree information on the comprehensive health degree information;
a fifteenth unit, configured to perform weighted calculation on each independent health degree information according to a weight threshold of each independent health degree information, so as to obtain the comprehensive health degree information; the weight threshold value of the independent health degree information in the time dimension close to the current moment is larger than the weight threshold value of the independent health degree information in the time dimension far from the current moment.
Optionally, the server may further include:
a fifth module, configured to determine a preset query rate coefficient per second corresponding to a health degree interval according to the health degree interval in which the comprehensive health degree information is located;
a sixth module, configured to calculate, according to the maximum query rate per second of the target service system and the preset query rate per second coefficient, an actual query rate per second of the target service system;
and a seventh module, configured to determine a real-time flow control policy of the target service system according to an actual query rate per second of the target service system.
Optionally, the server may further include:
an eighth module, configured to continuously send a probe request to the target service system when the target service system is in a disconnection state, until it is determined that the target service system resumes a connection state according to the received response information of the target service system;
a ninth module, configured to sequentially send access requests corresponding to the flow opening thresholds to the target service system according to a preset flow opening threshold set; the traffic opening threshold set comprises a plurality of traffic opening thresholds under different time nodes, and each traffic opening threshold is used for representing the maximum number of access requests receivable by the target service system under each time node.
Optionally, the ninth module includes:
a sixteenth unit, configured to select a first traffic opening threshold with a minimum value from the traffic opening threshold sets as a current traffic opening threshold, and send a first access request set with a number smaller than the current traffic opening threshold to the target service system that recovers the connection state;
seventeenth unit, configured to, when a request processing success rate of the first access request set meets a target ratio, sequentially select, according to a threshold size, a second traffic opening threshold that is greater than the first traffic opening threshold from the traffic opening threshold sets as a current traffic opening threshold, and send, to the target service system, a second access request set that meets the current traffic opening threshold until a maximum traffic opening threshold in the traffic opening threshold sets is taken as the current traffic opening threshold.
Optionally, the server may further include at least one of:
a tenth module, configured to configure system maintenance information of the target service system; wherein the system maintenance information is used to characterize the inaccessible time of the target business system;
an eleventh module, configured to configure a blacklist request table and a whitelist request table of the target service system, where an access request in the blacklist request table is configured to be unable to access the target service system, and an access request in the whitelist request table is configured to be accessible to the target service system;
and a twelfth module, configured to configure a maximum number of requests supportable by the target service system in a unit time.
Optionally, the server may further include at least one of:
a thirteenth module, configured to obtain a current flow opening threshold of the target service system according to the real-time flow control policy, and determine that the current limiting state of the target access request is an inaccessible state when the current access amount of the target service system is greater than the current flow opening threshold; when the current access quantity of the target service system is smaller than or equal to the current flow opening threshold value, determining that the current limiting state of the target access request is an accessible state;
A fourteenth module, configured to obtain a blacklist request table and a whitelist request table of the target service system according to the real-time flow control policy, identify a request identity of the target access request according to the blacklist request table and the whitelist request table, and determine that a current limit state of the target access request is an accessible state when the target access request is a whitelist request; when the target access request is a blacklist request, determining that the current limiting state of the target access request is an inaccessible state;
and a fifteenth module, configured to perform flow control on the target access request according to the current limiting state of the target access request.
Another aspect of the embodiment of the invention also provides an electronic device, which includes a processor and a memory;
the memory is used for storing programs;
the processor executes the program to implement the method as described above.
Another aspect of the embodiments of the present invention also provides a computer-readable storage medium storing a program that is executed by a processor to implement a method as described above.
Another aspect of embodiments of the invention also provides a computer program which, when executed by a processor, implements a method as described above.
According to the embodiment of the invention, the historical access condition information of the target service system is acquired at intervals to master the accessed real-time flow condition of the target service system, the independent health degree information of the target service system under a plurality of different time dimensions is obtained through calculation, the comprehensive health degree information of the target service system is determined according to the independent health degree information, the real-time flow control strategy is determined, and the flow control of the target access request is completed. In addition, according to the embodiment of the invention, independent health degree information of the target service system in a plurality of different time dimensions can be determined according to the historical access condition information, and comprehensive health degree information of the target service system is determined according to each independent health degree information.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are needed in the description of the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic diagram of an implementation environment provided by an embodiment of the present invention;
FIG. 2 is a flow chart illustrating steps of a flow control method according to an embodiment of the present invention;
FIG. 3 is a flowchart illustrating steps for calculating comprehensive health information according to an embodiment of the present invention;
fig. 4 is a flowchart of a step of a target service system recovery method according to an embodiment of the present invention;
fig. 5 is a schematic diagram of a method for recovering a target service system with "fast start and slow lift" according to an embodiment of the present invention;
FIG. 6 is a schematic diagram of a flow control system according to an embodiment of the present invention;
FIG. 7 is a flowchart of steps for accessing a banking system;
fig. 8 is a schematic structural diagram of a server according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application will be further described in detail with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the present application.
In order to facilitate understanding of embodiments of the present invention, related concepts related to the present application are briefly described below.
CKV: a distributed memory KV storage system can support atomic operation of data.
NTP: network Time Protocol, time synchronization server. NTP is a protocol that synchronizes computer time, allows a computer to synchronize its server or clock source, provides high-precision time correction, and prevents protocol attacks by way of cryptographic validation.
The capacity of the business systems such as banks, stations and the like for processing the access amount of the objects is greatly limited by the performance of hardware, and when a large number of object accesses are received in a short time by the business systems, the normal processing flow of the business systems may be affected. In order to maintain long-term stable operation of the service system, a curing flow control manner is generally adopted in the related art to control the flow of the service system.
Flow control, i.e., flow control, refers to the control of flow to a computer network by means of software, hardware, or a combination of software and hardware. And for the flow control of the service system, the method refers to the control of the access quantity of the service system in the embodiment of the invention. Therefore, the method of solidification flow control in the related art specifically refers to fixing the upper limit of the access amount of the service system, thereby achieving the purpose of protecting the service system from the processing pressure caused by excessive object access.
However, there may be significant differences in the amount of traffic access received by the traffic system at different times. For example, business systems such as banks and stations often have peaks in a year before holidays and festival, for example, the objects of the business systems of banks before spring festival have larger asset access requirements; and the access amount of the object of the station service system can be obviously increased before and after spring transportation. In addition, in the same service system, the access amount of the object to different types of services may also be different. For example, in banking systems, the amount of access to stored value services by an object may be higher than to investment services. Therefore, in the actual running process of the service system, the method for solidifying and controlling flow in the related technology cannot be well adapted to the variable object access condition of the service system, and the method for manually setting the upper limit of the multi-section access is complex in configuration and low in efficiency.
In addition, with the continuous development of hardware technology, the updating speed of the service system is also continuously accelerated, the throughput of the service system is also increased, and if the service system still depends on the previously set upper limit of the access amount to operate, the resource of the updated service system is definitely wasted; if the upper limit of the access amount of each service system is manually reset, even the corresponding upper limit of the access amount is reset for each service in the service system, the mode of adapting to the resource change of the service system obviously needs to consume a lot of time, has poor instantaneity and lower efficiency, and is difficult to match with the daily and monthly development speed of the current internet technology.
Based on the above, the embodiment of the invention provides a flow control method, which acquires the historical access condition information of a target service system at intervals to master the accessed real-time flow condition of the target service system, further calculates and obtains the independent health degree information of the target service system under a plurality of different time dimensions, determines the comprehensive health degree information of the target service system according to each independent health degree information, determines the real-time flow control strategy, and completes the flow control of a target access request. In addition, the embodiment of the invention can determine the comprehensive health degree information of the target service system in a plurality of different time dimensions according to the historical access condition information, and the embodiment of the invention combines the comprehensive response levels of the target service system in a plurality of different time dimensions to determine the real-time flow control strategy, so that the real-time flow control strategy can reflect the influence degrees of different time dimensions, and the accuracy of the real-time flow control strategy is further improved.
The flow control method provided by the embodiment of the invention can be applied to the implementation environment shown in fig. 1. The implementation environment shown in fig. 1 includes a plurality of terminal devices 101 and a server 102. The terminal equipment can communicate with the server in a wired or wireless mode. The wireless connection includes, but is not limited to, a WIFI (Wireless Fidelity ) connection, a cellular data connection, a bluetooth connection, or an infrared connection; the wired connection comprises a USB ((Universal Serial Bus, universal serial bus) connection-in fig. 1 the terminal device and the server are shown in communication connection via a communication network 103.
The terminal device in the embodiment of the present invention may be any electronic product capable of accessing the service system in the embodiment of the present invention, for example, a personal computer (Personal Computer, PC), a mobile phone, a smart phone, a personal digital assistant (PersonalDigital Assistant, PDA), a wearable device, a palm computer PPC (Pocket PC), a tablet computer, etc., and the terminal device is shown in fig. 1 as a mobile phone and a personal computer. The object can perform man-machine interaction with the terminal equipment through one or more modes such as a keyboard, a touch pad, a touch screen, a remote controller, voice interaction or handwriting equipment, and various services in the service system are accessed through the terminal equipment. And the terminal equipment sends the service access request to the server through the communication network according to the operation of the object.
The server in the embodiment of the invention can be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, and can also be a cloud server for providing cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks (Content Delivery Network, CDNs), basic cloud computing services such as big data and artificial intelligent platforms and the like. The server can run the service system in the embodiment of the invention, receive and process the service access request sent by the terminal equipment, and return the processing result (namely the service access response) of the service access request to the terminal equipment. In addition, the server is also used for making a real-time flow control strategy of the service system according to the service access request so as to realize dynamic flow control of the service system access request, thereby further improving the stability of the service system.
In some embodiments, the servers described above may also be implemented as nodes in a blockchain system.
The service system in the embodiment of the invention can comprise a payment system of a payment mechanism, a service system of a banking mechanism or an online ticket purchasing system and the like, wherein the payment mechanism can be a payment mechanism of daily consumer goods of residents such as water, electricity, fuel gas, broadband and the like, for example, the payment mechanism can be a public institution providing water service, an operator providing broadband service and the like; the service system of the banking institution is a business system capable of providing the object with the services of money storage, risk investment and the like; the online ticket purchasing system is a business system which can provide ticket purchasing services for vehicles such as trains, planes and the like, events such as singing concerts, drama performances and the like, or places such as scenic spots, amusement parks and the like.
In the embodiment of the invention, the service system operates in the server, for example, the service system is a service system of a bank, the service system can be suspended for the reasons of system update or failure in the operation process, and a large number of backlogged access requests need to be processed when the service system restarts to serve; still alternatively, as mentioned above, service system may have service access peaks before and after festival, and service system needs to process a large number of access requests in a short time. As can be seen, traffic systems often need to cope with traffic surges. However, since the processing capacity of the service system is greatly limited by the hardware performance, the flow control scheme in the related art is difficult to efficiently and timely solve the dilemma of the service system, so that the instability of the service system in operation is increased, the manual operation and maintenance cost is increased, and the experience of the object in using the service system is also reduced. Therefore, the present application proposes a flow control method, as shown in fig. 1, in which a server receives service access requests from a plurality of terminal devices, and determines a real-time flow control policy capable of dynamically changing along with a current comprehensive response level of a service system, processes the service access requests according to the real-time flow control policy, and returns a processing result of the service access requests to the corresponding terminal device. The flow control method of the embodiment of the invention realizes the efficient and accurate matching of the real-time flow control strategy of the service system and the processing capacity of the service system, and further improves the running stability and the processing efficiency of the service system.
Referring to fig. 2 with reference to the implementation environment shown in fig. 1, fig. 2 is a flowchart illustrating steps of a flow control method according to an embodiment of the present invention, where the method may be implemented by the server 102 in fig. 1, and the method specifically includes, but is not limited to, the following steps S200-S230:
s200, acquiring historical access condition information of a target service system every time a preset time period passes; the historical access condition information is used for representing the flow condition of the accessed target service system;
specifically, in the above description, the solution of solidification flow control in the related art is firstly difficult to match with the daily and monthly service processing capability of the service system, and in addition, it is difficult to solve the problems of insufficient processing capability, unstable operation and the like of the service system, which may be caused by large fluctuation of access amount in different time dimensions. Therefore, the flow control method provided by the embodiment of the invention focuses on the latest service access condition of the service system and dynamically changes the real-time flow control strategy according to the access condition, thereby achieving the purposes of fully exerting the processing capacity of the service system and maintaining the stable operation of the service system.
Therefore, the flow control method provided by the embodiment of the invention needs to collect the service access condition of the service system. In the embodiment of the present invention, the target service system is a service system that needs to perform flow control, and specifically may be at least one of a banking service system, an online ticket purchasing system, or a payment system mentioned in the foregoing, which is not described herein in detail. In this step, the historical access condition information is obtained from the data storage space storing the data of the target service system every preset time period because the service access condition of the target service system changes with time. The data storage space may be at least one of a local storage, a database, a cloud storage, and the like.
In the embodiment of the invention, the preset duration refers to a time interval between when the required data is acquired from the data storage space storing the target service system data and when the data is acquired again from the data storage space next time. It can be appreciated that, in order to simplify the design flow of the system, it is also convenient for the service system operator to perform data query, and in some embodiments, the preset duration may refer to time intervals with equal lengths. For example, the preset duration is set to be 30 minutes, the historical access condition information of the target service system is acquired for the first time from 9:00, then the historical access condition information is acquired for the second time at 9:30, the historical access condition information is acquired for the third time at 10:00, and the required historical access condition information is acquired from the data storage space according to fixed time intervals by the same.
While the above mentions that, for the service system, the size of the fluctuation generated by the access situation of the service system varies considerably from the different time dimension. Also taking the banking system mentioned above as an example, in the beginning of spring festival, residents often need to access the banking system of the bank through software such as mobile phone internet banking or go offline to the bank to access the banking system of the bank by bank staff, so that the service access amount of the banking system is greatly increased. That is, with the month as the time dimension, the month (e.g., 1-2 months) near the spring festival is likely to be the peak of the bank business system business access volume. Whereas, for example, 3-4 months just ending in spring festival may be "off season" of banking business, the access amount of business system is generally lower and fluctuation is slower than 1-2 months. It can be seen that if the data acquisition is performed by adopting a fixed preset duration all the time, when the banking business is busy, the acquired historical access condition may not be enough to fully characterize the access condition of the business system, and the hysteresis of the flow strategy may be increased; when banking is relatively less, a method of frequently acquiring historical access status information according to a fixed preset time length and updating a real-time flow control policy may result in waste of computing resources. Thus, in consideration of the above, in other embodiments, the preset time periods may be time intervals with unequal lengths, for example, in a year, according to a general trend of variation of the access amount of the service system, different preset time periods are adopted in different months to acquire data. If the preset time length is set to be 15 minutes in 1-2 months, historical access condition information is acquired from a data storage space of the banking system every 15 minutes; and in 3-4 months, setting the preset time length to be 4 hours, and acquiring the historical access condition information again every 4 hours. The embodiment reduces the occupation of communication resources or storage space caused by data transmission under the condition of considering the real-time performance of the real-time flow control strategy.
While in other embodiments the preset time period may also vary irregularly in a smaller time dimension. Taking a bank business system as an example, the time for providing service by the bank system may be from 8 am to 6 pm, and the business access amount is maximum in two time periods of 9-11 am and 3-5 pm, then the unit of day may be set, for example, the preset time period for acquiring data may be set longer, for example, 30 minutes, at 8-9 am; setting to acquire historical access condition information every 10 minutes when the time period of 9-11 points is reached; the rest time period of the day is also set for a preset time period according to the service access condition under the general condition. In this way, the server can also be assisted in improving the accuracy of making flow control decisions.
In summary, the preset duration in the embodiment of the present invention may be set according to the actual service access situation of the service system, and the rest of the setting methods are not described herein.
It should be noted that, the length of the time period corresponding to the preset duration and the acquired historical access condition information may be the same or different. For example, in some embodiments, it is set that the historical access condition information is acquired every 5 minutes, the data is acquired for the first time at 9:00, and the data is acquired for the second time at 9:05, and the historical access condition information acquired for the second time may be all the access condition information generated in the time period of 9:00-9:05 (that is, the same time period as the preset time length). In this way, the historical access condition information obtained by the server is complete and coherent, and has positive influence on improving the accuracy of the specified flow control decision. In other embodiments, the service access amounts may be consistent within the preset time period, and the fluctuation is small, so that the length of the time period corresponding to the obtained historical access condition information may be smaller than the preset time period. For example, it is set that history access status information is acquired every 1 hour, and at 9:00 first data acquisition, at 10:00 second data acquisition, then the second acquired historical access condition information may be at 9: all access condition information generated during the period of 30-10:00, and the part of historical access condition information can be taken as representative of business access condition information during the period of 9:00-10:00. Such a processing scheme can reduce the pressure of data transmission and storage based on the traffic access volume in response to this period of time.
In the embodiment of the invention, the historical access condition information is used for representing the accessed flow condition of the target service system, and the content contained in the historical access condition information can be different according to the actual flow control process. Since traffic conditions of the service system are closely related to time, the embodiment of the invention acquires historical access condition information according to time periods. The history period refers to a period of time earlier than the current time, that is, a period of time corresponding to the acquired history access condition information mentioned in the above. Since various setting schemes that may exist for this period have been mentioned above, a description of the specific setting scheme for the historical period will not be provided here.
First, the historical access condition information may include the traffic access volume mentioned above, precisely the total number of access requests for the target traffic system over the historical period of time. It can be understood that if the total number of access requests of the service system is very large in the specified historical time period, the processing pressure of the service system can be reflected to be very high, and flow control is required.
Similarly, the historical access condition information may further include initiation time information of an access request of the target service system in the historical period, time-consuming information of the access request of the target service system in the historical period, access success-failure information of the access request of the target service system in the historical period, and object information of the access request of the target service system in the historical period.
The time-consuming information of the access request refers to the time spent in the process from the time when the terminal equipment sends the current access request to the time when the terminal equipment receives the processing result of the current access request returned by the service system. It can be thought that after the terminal device sends the access request, the service system takes longer to process the access request, which indicates that the current service system may accumulate more access requests and needs queuing processing; or alternatively, insufficient processing power, resulting in a reduced speed of processing individual access requests.
According to the above, the service system may need queuing processing when the total number of access requests is large, or may split the computing power into multiple access requests, resulting in a slow processing speed of the access requests. When the access request sent by the terminal equipment has timeliness requirements, after the current access request is sent, the service system can not process the access request completely in the preset timeliness, and the service system can return a response of processing failure to the terminal equipment; otherwise, after the processing is finished, a response of successful processing can be returned. Therefore, the access success or failure information of the access request of the target service system in the historical time period can also represent the urgency degree of the service system needing to perform flow control.
In addition, since the server in the application may be an independent server or a server cluster, the server may serve multiple service systems, and in order to distinguish access requests of different terminal devices to different service systems, the historical access status information may further include object information of access requests of the target service system in a historical time period, where the object information includes an identifier of a service system to be requested and an identifier of a current access request. The identification may be sent to the server in plain text or ciphertext with the access request.
S210, determining independent health degree information of a target service system in a plurality of different time dimensions according to historical access condition information, and determining comprehensive health degree information of the target service system according to each independent health degree information; each piece of independent health degree information is used for representing the response level of the target service system in the corresponding time dimension, and the comprehensive health degree information is used for representing the comprehensive response level of the target service system; the influence degree of the independent health degree information under different time dimensions on the determination of the comprehensive health degree information is different;
specifically, after the historical access condition information is obtained in step S200, a real-time flow control policy of the service system may be formulated according to the historical access condition information. In the embodiment of the invention, the concept of comprehensive health degree information of the target service system in different time dimensions is provided, wherein the comprehensive health degree information is used for representing the comprehensive response level of the target service system. Compared with a real-time flow control strategy formulated by a single variable such as the number of access requests received by a service system, the comprehensive health information provided by the embodiment of the invention can provide a more scientific basis for formulation of the real-time flow control strategy, and the comprehensive health information in the embodiment of the invention is associated with a time dimension, so that the calculation accuracy of the real-time flow control strategy can be improved. For example, for the independent health degree information under different time dimensions, the embodiment of the invention can respectively give different calculation weights, and further calculate to obtain the comprehensive health degree information according to the different independent health degree information, and it can be understood that the calculation result of the comprehensive health degree information is affected by the different independent health degree information to different degrees, and the influence degree of the independent health degree information with larger weight value on the comprehensive health degree information obtained by final calculation is also larger, so that different weight values can be given to the different independent health degree information according to the flow control requirements of the target service system under different time dimensions, so that the result of the comprehensive health degree information obtained by final calculation can be the best fit with the current response situation of the target service system, and the control accuracy of the control strategy is improved.
Referring to fig. 3, fig. 3 is a flowchart illustrating steps for calculating integrated health information according to an embodiment of the present invention, where the method specifically includes, but is not limited to, steps S300-S320:
s300, calculating average time consumption information of a target service system and unit time statistical information of the target service system under different time dimensions according to the historical access condition information;
specifically, the average time-consuming information refers to the average time consumption required by the current target service system to process an access request. The average time-consuming information may be calculated from the time-consuming information of the access requests of the target service system and the total number of access requests within the history period of time in the history access condition information. For example, if average time-consuming information in one day is needed to be obtained, the sum of time-consuming corresponding to all access requests processed by the target service system in the same day is calculated first, and then the calculated sum of time-consuming is divided by the total number of access requests, so that average time-consuming required by the target service system in the same day to process a single access request is calculated. It can be appreciated that the average time-consuming information considers the access requests successfully processed and the access requests unsuccessfully processed in the calculation, so that the average time-consuming information can objectively reflect the access request processing condition of the target service system on the same day. Meanwhile, in the embodiment of the invention, when the comprehensive health degree information of the target service system is calculated, the average time consumption information is required to be used as a reference of the health condition, so that the historical access condition information close to the current time is selected as much as possible for calculation when the average time consumption information is calculated. For example, when calculating the current integrated health degree information, it is possible to calculate average time-consuming information of the previous day in consideration of the historical access condition information of the previous day, taking the average time-consuming information as a reference.
The unit time statistical information refers to statistical information of the processing condition of the service system on the access request in a preset unit time range. As mentioned above, there may also be significant differences in the access requests it receives between the various periods of the day for a portion of the business system. Therefore, it is difficult to comprehensively reflect the access processing condition of the business system only by means of the average time-consuming information. It will be appreciated that the process of processing the access requests by the service system is continuous, for example, all access requests in the current access request list cannot be processed in the previous time period, and in the next time period, not only new access requests but also access requests left in the previous time period need to be received. In contrast, after the access request in the previous time period is processed, the service system can concentrate on processing the access request received in the current time period when the next time period starts, and the processing efficiency is improved. Therefore, the statistic information of unit time in a single unit time range can only represent the access request processing condition in the unit time range on one side, and the reference meaning for the server to formulate the real-time flow control strategy of the next time period of the target service system is limited.
Therefore, the embodiment of the invention provides that the statistical information of unit time under different time dimensions is required to be calculated, so that a more comprehensive reference is provided for a server to formulate a real-time flow control strategy of the next time period of the target service system. In this step, the different time dimensions may be understood as a plurality of time periods with different time ranges, for example, the set time dimensions include a first time dimension, a second time dimension and a third time dimension, where the first time dimension is 1 minute, the second time dimension is 5 minutes, and the third time dimension is 20 minutes, and then under the first time dimension, the unit time range refers to the first 1 minute of the current time; in the second time dimension, the unit time range refers to the first 5 minutes of the current time; similarly, in the third dimension, the unit time range refers to the first 20 minutes of the current time. Because the unit time range is changed in different time dimensions, the unit time statistical information obtained in the unit time range can more comprehensively reflect the access request change condition of the target service system, thereby providing more accurate reference for the real-time flow control strategy of the next time period.
It should be noted that, there is no necessary relationship between the above-mentioned unit time and the time length setting of the history time period, in general, in order to reduce the resource occupation caused by frequently acquiring the history access condition information from the data storage space, the time length of the unit time should be shorter than the time length of the history time period, for example, the history time period is set to 30 minutes, and then only the history access condition information in the history time period before the current time is required to be acquired once, so that the unit time statistics information in three time dimensions of the first 1 minute at the current time, the first 5 minutes at the current time, and the first 20 minutes at the current time can be obtained.
In the above description, the unit time statistics information refers to statistics information of processing conditions of the service system on the access request within a preset unit time range, where the unit time statistics information specifically includes a total request amount, a successful request amount, average time consumption and a duty ratio coefficient of the successful request amount of the target service system in unit time.
The total request amount per unit time may be obtained from the total number of access requests of the target service system in the history period, and if the history period is 30 minutes and the unit time is 1 minute, as exemplified in the above, the total request amount of the last 1 minute in the history period is determined as the total request amount per unit time. According to the access success and failure information of the access request of the target service system in the historical time period, the successful request quantity of the target service system in unit time can be calculated and obtained, wherein the successful request quantity refers to the quantity of the access requests which are processed by the service system and return corresponding processing success results to the terminal equipment. And the processing results (success or failure) of all the access requests in the historical event section are recorded in the access success or failure information, so that the successful request quantity of the target service system in unit time can be determined. For example, the historical time period is 30 minutes, the unit time is 1 minute, 10 access requests are processed by the service system in the last 1 minute of the historical event period, 8 of the access requests are processed and the successful processing results are returned to the terminal equipment, and 2 of the access requests are not processed over time, or the service system fails to process; the successful request amount per unit time is 8. In addition, according to the time consumption information of the access request aiming at the target service system in the historical time period, the average time consumption of the target service system in unit time can be calculated. The average time consumption herein refers to the time required for the target service system to process 1 service request per unit time, unlike the above-mentioned average time consumption information. For example, the historical time period is 30 minutes, the unit time is 1 minute, and the service system processes 10 access requests in the last 1 minute of the historical event period, so that the average time spent processing 1 service request in the unit time is 6 seconds.
In addition, according to the total request amount of the target service system in unit time and the successful request amount of the target service system in unit time, the duty ratio coefficient of the successful request amount can be calculated. More specifically, the duty ratio of the successful request amount refers to the ratio of the successful request amount to the total request amount in the access requests received by the target service system per unit time. Obviously, the larger the ratio of the successful request amount in the total request amount, the higher the success rate of the target service system for processing the access request is proved, and the more healthy the target service system can be considered. For example, the historical time period is 30 minutes, the unit time is 1 minute, 10 access requests are processed by the service system in the last 1 minute of the historical event period, 8 processing ends, and a successful processing result is returned to the terminal device, so that the duty ratio coefficient is calculated to be 0.8.
In addition, in the practical application scenario, the duty ratio coefficient may also be an empirical value preset according to prior data. In different service systems, the requirements for success rates of access requests sent by the terminal device may not be uniform, and even in the same service system, the requirements for success rates of access requests for different services may also be different. For example, for a banking system, there may be some services with relatively high requirements on timeliness, for example, the object needs to query the real-time balance of an account, or the object needs to complete a small transfer, etc., and the amount of data required to be processed by the part of services is relatively small, or the amount of money involved is relatively small, so that the banking system needs to process the part of services quickly, accurately and with high success rate. For some services with lower timeliness, such as large transfer of money, purchase of investment products and the like, the object is in a mobile banking, and because of longer processing time limit, even if the current access request fails, the terminal equipment can initiate a request to a service system running in a server for a plurality of times by a background until the request of the object is completed. In this case, the duty cycle requirements of the successful request volume in the total request volume may be relatively relaxed. Based on the above situation, in the actual application scenario, the duty ratio coefficient may be manually set according to the need, where the duty ratio coefficient has a value of 0 to 1, for example, the duty ratio coefficient of the current target service system may be set to 0.7 according to experience, and in the subsequent calculation process, the duty ratio coefficient is set to 0.7 for calculation.
It can be seen that in the process of calculating the health degree in the above embodiment, reference is made to the case that the target service system successfully processes the access request, so as to help measure whether the target service system is healthy. In other embodiments, the ability of the target service system to process the access request may be measured from another aspect, for example, the risk may be calculated instead of the health, and the risk may be quantitatively calculated with reference to the failure of the target service system to process the access request. The embodiment of the invention mainly aims at describing the health degree of the business system.
S310, calculating to obtain independent health degree information in each time dimension according to the average time consumption information and the unit time statistical information in different time dimensions;
specifically, after the average time-consuming information and the statistical information of unit time in different time dimensions are calculated in step S300, the independent health degree information in different time dimensions may be calculated according to the above information. In the above, it is mentioned that, in the embodiment of the present invention, the integrated health information is used to represent the integrated response level of the target service system, and correspondingly, the independent health information is used to represent the integrated corresponding level of the target service system in different time dimensions. Assuming that the preset first time dimension, second time dimension and third time dimension are 1 minute, 5 minutes and 20 minutes respectively, the independent health degree information in the first time dimension can be obtained through calculation through average time consumption information and unit time statistical information in the first time dimension. The calculation of the individual health information is described below with the example of a first time dimension of 1 minute.
Step S300 above first provides average time-consuming information of the target service system under the historical access condition, and it is assumed that the average time-consuming information of the previous day is calculated according to the historical access condition information of the previous day, the calculation parameters of the independent health degree information are performed according to the average time-consuming information, and useTime is used avg Representing average time-consuming information of the previous day. Then, the above step S300 further expands the statistics of the unit time of the target service system to include the total request amount of the target service system in unit time, the successful request amount in unit time, the average time consumption in unit time, and the duty ratio coefficient of the successful request amount. In unit time, with reqNum all Representing the total request quantity by reqNum period Indicating the amount of successful request, using useTime period And (3) representing average time consumption, and representing a duty ratio coefficient by m, wherein according to the average time consumption information of the target service system under the historical access condition, the total request amount of the target service system in unit time, the successful request amount in unit time, the average time consumption in unit time and the duty ratio coefficient of the successful request amount, the independent health degree information under each time dimension can be obtained through calculation. The health index is used to represent the independent health information in the current time dimension, and then the health index conforms to the following formula:
The above formula is a calculation formula of independent health degree information under each time dimension provided in the embodiment of the present invention, for example, under a time dimension of 1 minute per unit time, the calculated independent health degree information may be a health index 1min To represent. Similarly, under the time dimension of 5 minutes per unit time, the heath index is calculated 5min The method comprises the steps of carrying out a first treatment on the surface of the Under the time dimension of 20 minutes per unit time, the heath index is calculated 20min . It can be appreciated that, according to the requirements of the actual application scene, the method alsoMore and larger time dimensions can be set, and corresponding independent health degree information can be calculated.
And after calculating the independent health degree information in each time dimension according to the average time consumption information and the unit time statistical information in different time dimensions, storing the independent health degree information into a corresponding data storage space, such as a database of a server.
S320, calculating to obtain comprehensive health degree information according to the independent health degree information in each time dimension;
specifically, after the independent health degree information in each dimension is obtained by calculation, the comprehensive health degree information can be obtained by calculation according to the influence of each independent health degree information on the comprehensive response condition of the current target service system. The comprehensive health degree information is used for representing the comprehensive response level of the current target service system, and the server can correspondingly formulate a real-time flow control strategy according to the comprehensive health degree information. In general, for example, the comprehensive health information shows that the current comprehensive response level of the target service system is low, and there may be situations of backlog of access requests, low processing speed, high processing error rate and the like, then the real-time flow control policy formulated by the server should focus on reducing the pressure caused by new access requests on the target service system, so that the target service system can process the backlog of access requests as soon as possible, and the situation that the target service system still bears larger request processing pressure in the next time period is avoided as much as possible. On the contrary, if the comprehensive health information shows that the current comprehensive response level of the target service system is higher, the real-time flow control strategy should tend to relax the current access request to the target service system so as to achieve the effect of fully playing the access request processing capability of the target service system.
In the above, it is mentioned that, because of the continuity of the process of processing the service access request by the service system, the response level of the service system to the access request in multiple time dimensions affects the response level of the service system at the current moment more or less. It can be understood that, because the service access request condition of the target service system fluctuates with time, the response level of the service system to the access request in different time dimensions has obvious difference on the influence degree of the comprehensive corresponding level of the service system at the current moment. Taking a more extreme example as an example, for example, taking the response level of the target service system 24 hours before the current time as a main reference, the reference meaning of the response level is quite limited for evaluating the response level of the current time, if the response level of the target service system 24 hours before the current time is taken as a main reference, the accuracy of the calculated response level of the current time is low, and it is difficult for the auxiliary server to formulate an accurate real-time flow control strategy. Also for example, with the response level of the target service system 30 seconds before the current time, the response level change that can occur per unit time for the target service system is rather limited for evaluating the response level at the current time, so that the effect of the response level of the target service system 30 seconds before the current time on the response level at the current time is obviously much greater than the effect of the response level other than 24 hours at the current time on the response level at the current time.
In addition, in the embodiment of the invention, the response level of the target service system in different time dimensions is quantified by the independent health degree information, and the comprehensive response level of the target service system at the current moment is quantified by the comprehensive health degree information, so that the following can be determined: the influence of the independent health degree information in the time dimension which is closer to the current moment on the comprehensive health degree information is larger than the influence of the independent health degree information in the time dimension which is farther from the current moment on the comprehensive health degree information. In the specific calculation process of the comprehensive health degree information, the difference of the influence is embodied specifically by the weight threshold difference of each independent health degree information, namely the weight threshold of the independent health degree information in the time dimension close to the current moment is larger than the weight threshold of the independent health degree information in the time dimension far from the current moment. The weight threshold of the independent health degree information is used for representing the influence degree of the current independent health degree information on the comprehensive health degree information. For example, assume that the first time dimension is 1 minute, the firstThe two time dimensions are 5 minutes, the third time dimension is 20 minutes, different weight thresholds are respectively set for the independent health degree information under the first time dimension, the second time dimension and the third time dimension, and the independent health degree information healthIndex under the first time dimension is assumed 1min The weight threshold of (2) is set to 0.7. Similarly, the weight threshold of the independent health information in the second time dimension is lower than that in the first time dimension, and the heath index is set 5min The weight threshold of (2) is 0.2; the weight threshold of the independent health degree information in the third time dimension is lower than that in the second time dimension, and the heath index is set 20min The weight threshold of (2) is 0.1. The difference of the weight thresholds can show different influences of the independent health degree information on the comprehensive health degree information under different time dimensions when the comprehensive health degree information is quantitatively calculated.
In the above, it is mentioned that the specific setting of the time dimension is not particularly limited in the embodiment of the present invention, that is, in addition to the three time dimensions listed in the above example, more or fewer time dimensions may be set in the actual application scenario to calculate the independent health degree information and the integrated health degree information. When the weight threshold is set, it is sufficient to note that the sum of the weight thresholds of the individual health degree information corresponding to all the time dimensions should be 1.
Additionally, in some embodiments, the weight threshold may be empirically set as in the examples above. In other embodiments, the weight threshold may also be determined from the ratio of the unit time in the time dimension to the sum of all unit times. For example, the first, second, and third time dimensions are respectively 2 minutes, 3 minutes, and 5 minutes, and the sum of all unit times is 2+3+5=10 minutes, and the ratio of the unit times of the first, second, and third time dimensions to the sum of all units is 0.2, 0.3, and 0.5, respectively, and according to the above, the weight threshold of the independent health degree information in the time dimension closer to the current time should be set to be larger, and the independent health degree information health index in the first time dimension may be set in order of the ratio from larger to smaller 2min Set to 0.2, the device is independent in the second time dimensionVertical health information healthIndex 3min Set to 0.3, the independent health degree information health index in the third time dimension is set 5min Set to 0.5. In other embodiments, the weight threshold corresponding to the independent health degree information in different time dimensions may be determined in other manners, so long as the condition that the weight threshold of the independent health degree information in the time dimension close to the current moment is greater than the weight threshold of the independent health degree information in the time dimension far from the current moment is met, and the embodiments of the present invention will not be described in detail herein.
According to the above, after the weight threshold of the independent health degree information under each time dimension is configured, the weight calculation can be performed on each independent health degree information according to the weight threshold of each independent health degree information, so as to obtain the comprehensive health degree information. For example, a first time dimension of 1 minute, a second time dimension of 5 minutes, and a third time dimension of 20 minutes, a heath index is configured 1min Weight threshold of 0.7, heath index 5min Weight threshold of 0.2, heath index 20min The weight threshold of (2) is 0.1, using a heath index period Indicating the integrated health information at the current time, the health index period The calculation process of (1) satisfies the following formula:
healthIndex period ＝0.7*healthIndex 1min +0.2*healthIndex 5min +0.1*healthIndex 20min
according to the above formula, the comprehensive health degree information can be calculated according to the independent health degree information in each time dimension.
Through the above steps S300-S320, the embodiment of the present invention describes a specific process of calculating the integrated health degree information. The content of calculating the integrated health degree information according to the independent health degree information in step S210 has already been explained through steps S300-S320, and the explanation of step S220 is continued.
S220, determining a real-time flow control strategy of the target service system according to the comprehensive health degree information;
specifically, the integrated health information capable of characterizing the integrated response level of the target system is calculated according to the above step S210. It is mentioned in the foregoing that the integrated health information can provide an important reference for the server to formulate a real-time flow control policy in the next time period of the target business system. For example, if the comprehensive health information shows that the current comprehensive response level of the target service system is higher, the flow control strategy can be relaxed, so that the target service system processes more new access requests in the next time period; otherwise, if the comprehensive health information shows that the current comprehensive response level of the target service system is lower, the flow control strategy can be properly narrowed, so that the target service system can intensively process backlogged access requests in the next time period.
The real-time flow control strategy provided by the embodiment of the invention has real-time performance related to the update speed of the comprehensive health degree information. For example, according to the preset duration set in the step S200, the historical access condition information of the target service system is obtained once every preset duration, then according to the obtained historical access condition information, new comprehensive health degree information is obtained through calculation in the method in the step S210, and then the server correspondingly adjusts the real-time flow control strategy of the previous period according to the latest comprehensive health degree information, or designates the latest real-time flow control strategy according to the latest comprehensive health degree information. Since it has been mentioned in the foregoing that the amount of access requests by the service system significantly fluctuates at different times, the real-time requirements for the flow control policy at different times also differ. For example, when the total number of access requests of the target service system is more, the server needs to increase the update speed of the real-time flow control strategy, so that the target service system can fully exert the processing performance and keep up with the increase speed of the access requests; conversely, when the total number of access requests of the target service system is smaller, the real-time requirement of the server on the real-time flow control strategy can be properly relaxed, so as to reduce unnecessary calculation power loss.
In an actual application scene, the processing capacity of a service system running in different servers for service access requests is also different due to the performance constraints of software and hardware of the different servers. And the same (or the same cluster) of servers may serve multiple business systems and multiple businesses within a business system, and there may be priorities between these business systems and businesses. For example, the a service system and the B service system both operate in the server C, and the priority of the a service system is higher, and the requirements of the supported services on timeliness and success rate are higher, then the server C may tilt more computing resources into the a service system when the computing resources are allocated, and needs to reserve enough computing resources for the a service system to buffer. The computing power resources of the server C that the B service system can enjoy are correspondingly reduced, so that the maximum threshold exists for the computing power resources that the B service system can enjoy. Similarly, based on the above, there may be different types of services in the same service system.
Therefore, in determining the real-time flow control strategy based on the integrated health information, the hardware support that the server can actually provide needs to be considered. In the embodiment of the invention, QPS (Query Per Second) is proposed as a measure of server hardware performance, where QPS refers to the number of queries that a current server can respond to Per Second, and can be used to measure the ability of the server to process access request traffic in a specified time period. In the embodiment of the invention, the comprehensive health degree information of the target service system is required to be related with the QPS of the server, and the number of times of responding access inquiry which can be provided by the service system under the current comprehensive health degree information is determined.
For the same service system, the maximum query rate per second (i.e., the maximum QPS) that a server running the service system can provide is fixed, except for special cases such as updating the server or the service system. Depending on the level of comprehensive response of the service system to the access request, the server may provide a different actual query rate per second (i.e., an actual QPS) corresponding to the maximum QPS that the server is capable of providing. In order to distinguish actual QPS corresponding to different comprehensive response levels of the service system, the embodiment of the present invention proposes that different preset query rate coefficients per second (i.e., preset QPS coefficients) need to be matched with different comprehensive health information. Specifically, the mapping relationship between the comprehensive health degree information and the preset QPS coefficient can be constructed through functions, formulas, tables and the like. As shown in the following table 1, table 1 is a mapping relationship table between an integrated health degree information interval and a preset QPS coefficient provided in the embodiment of the present invention.
TABLE 1
| Comprehensive health information interval | Presetting QPS coefficient |
| 95–100 | 1 |
| 80–94 | 0.8 |
| 60–79 | 0.5 |
| 40–59 | 0.2 |
| 0–39 | 0 |
As shown in table 1, in this embodiment, the integrated health degree information is specifically divided into a plurality of sections, and if the quantized value of the integrated health degree information is 0 to 100, the integrated health degree information is divided into five sections of 0 to 39, 40 to 59, 60 to 79, 80 to 94, and 95 to 100 according to table 1, and the five sections are respectively matched with different preset QPS coefficients. For example, assume that the calculated integrated health information healthIndex period =96, and 96 is located in the integrated health information area of 95-100Within the middle, then the heath index period The preset QPS coefficient corresponding to=96 is 1. Similarly, when the healthIndex is period =27, then heathndex period The preset QPS coefficient corresponding to=27 is 0. It will be appreciated that the value of the integrated health information calculated from the individual health information may be a fraction, such as the occurrence of a heath index period The case of =39.8, in which case the case is generally for the healthIndex period And (3) rounding the value of the (c) and then matching the preset QPS coefficient.
According to table 1, it can be determined that the larger the value of the comprehensive health degree information obtained by quantization calculation is, the larger the corresponding preset QPS coefficient is. The preset QPS coefficient represents the duty ratio of the actual QPS allocated to the target service system in the maximum QPS that the server can provide under the current integrated health information. That is, the actual qps=maximum qps×a preset QPS coefficient. For example, if the preset QPS coefficient corresponding to the current integrated health degree information is 1, it indicates that the health condition of the current target service system is relatively excellent, and the service system can release the largest computing power resource to process the new access request, and then the actual qps=the largest QPS. And so on, if the preset QPS coefficient corresponding to the current comprehensive health degree information is 0.8, it indicates that the health condition of the current target service system is good, but some computing power resources are reserved to process backlog access requests or other services, so that the actual qps=0.8×the maximum QPS.
It should be noted that, in the process of constructing the mapping relationship between the integrated health information interval and the preset QPS, the dividing standard of the integrated health information interval may be set according to the actual application scenario. That is, more or less than the 5 sections shown in table 1 may be divided to meet the actual flow control requirement, and correspondingly, the preset QPS coefficient may be divided more finely or more simply, and only the preset QPS coefficient needs to be paid attention to the value of 0 to 1. The size of the comprehensive health degree information section can be set according to the actual application scene, and the sizes of the sections can be the same or different. For example, in the case where the value of the comprehensive health information degree is relatively low, the primary task of the current target service system is to process backlogged access requests, so as shown in table 1, in a relatively large score interval of 0-39, the corresponding preset QPS coefficients are all 0, that is, the actual qps=0, which means that the target service system does not process new access requests at all in this interval, so as to ensure that the target service system can process all backlogged access requests smoothly. In the interval 40-59 partitions, the actual QPS can be opened in small amounts, a small amount of access requests can be processed, and according to the value of the comprehensive health degree information, more computing power resources are correspondingly opened gradually for processing the access requests.
According to the mapping relation table between the comprehensive health degree information interval and the preset QPS coefficient shown in table 1, or other data such as a table, a formula, a function and the like capable of integrating the mapping relation between the health degree information and the actual QPS, the actual QPS corresponding to the current comprehensive health degree information can be determined, and the actual QPS can be used for determining the real-time flow control strategy of the target service system.
S230, performing flow control on the target access request according to a real-time flow control strategy;
specifically, the target access request refers to an access request sent by the terminal device to the target service system. In the step S220, it is proposed that the real-time flow control policy of the target service system can be determined according to the actual QPS. The specific content of the real-time flow control strategy may vary according to the actual application scenario. For example, the real-time flow control policy may include limiting the total number of access requests sent to the target service system by the terminal device in the current time period, for example, taking the actual QPS as the maximum QPS in the current time period, and then calculating the maximum number of access requests that can be received by the target service system in the current time period according to the actual QPS and the duration of the current time period. The server counts the access requests at the beginning of the current time period, and when the total number of access requests is equal to the maximum number of access requests, the remaining time of the current time period no longer receives new access requests. For access requests sent in the remaining time in the current time period, the access requests can be stored in a storage space such as a message sequence, and the next time period is waited for consumption; or the server directly sends processing failure response for the access requests to the terminal equipment, for example, the processing failure response is displayed on an interface of the terminal equipment in a popup window or the like form: "the current system is busy, please try again later. "
In other embodiments, the real-time flow control policy may further allocate computing power resources according to different services of the target service system using the actual QPS, for example, in the target service system, calculate, through the actual QPS and the duration of the current time period, the maximum number of access requests that the target service system can receive in the current time period, and allocate an access request threshold corresponding to each service according to the maximum number of access requests, for example, the maximum number of access requests of the target service system in the current time period is 100, the a service in the target service system is a more important advanced service, the B service is a normal service, then allocate 80 access requests as thresholds for the a service, allocate 20 access requests as thresholds for the B service, and then in the current time period, the target service system receives and processes the access requests according to the access request thresholds of the a service and the B service, respectively.
In still other embodiments, the real-time flow control strategy may also set the access request reception rate per unit time during the current time period. For example, when the actual QPS is relatively large, assuming that the current time period is 5 minutes and the unit time is 30 seconds, the acceptance rate of the access requests in every 30 seconds may be set to 80%, that is, 10 access requests are received in 30 seconds, 8 access requests are randomly received and processed, and the remaining 2 access requests are buffered or the processing failure result is directly returned.
Through the steps S200-S230, the embodiment of the present invention provides a method step for performing flow control on a target access request of a target service system, which mainly includes continuously acquiring historical access condition information of the target service system according to a preset duration, determining comprehensive health information capable of reflecting a comprehensive response level of the target service system according to the historical access condition information, and finally formulating a real-time flow control strategy of the target service system according to the comprehensive health information, and performing flow control on the target access request according to the real-time flow control strategy.
Through the above, the embodiment of the invention describes the flow control method in the normal working process of the service system. In an actual application scenario, a service system usually has some special working intervals. A ticketing system for a vehicle such as a bank's business system and a train is not normally open to access by an object 24 hours a day, e.g., a ticketing system for a train is 11:00 to 4:00 in the morning of the next day generally does not open business functions. Still alternatively, the business system may perform an upgrade maintenance work of the system for a fixed period of time within a week or month, and the business system may not be able to provide service during system design maintenance. In the special working interval, there may be some exceptional cases, such as that the advanced object of the service system can still access the service during the maintenance of the service system; in contrast, the blacklisted object of the service system can reject the access request of the object no matter in any time period. Therefore, for the special case that the target service system is out of the normal workflow, the corresponding special event information needs to be configured in the service system in advance.
In view of the foregoing, from a time perspective, first the special event information of the target business system may include system maintenance information that characterizes the inaccessible time of the target business system, during which the target business system performs routine maintenance and upgrades of the system. For example, the system maintenance information for setting up the banking system includes: the system is inaccessible from 8:00 a day to 8:00 a day in the morning, and the system maintenance time for the business system is also set for every Saturday, so that the banking system is inaccessible in the two preset time ranges. That is, when the terminal device sends an access request to the target service system within the inaccessible time, the server will directly return the result of the processing failure to the terminal device, for example, prompt in a popup window form on the display interface of the terminal device: "currently is a system maintenance period, please retry during the system operation period". And correspondingly configuring system maintenance information according to the actual requirements of different service systems.
From the object perspective, the special event information may further include a blacklist request table and a whitelist request table of the current target service system, wherein the request table includes object information of the object and terminal information, the access request of the blacklist object in the blacklist request table is configured to be inaccessible to the target service system, and the access request of the whitelist object in the whitelist request table is configured to be accessible to the target service system. In combination with practical situations, for example, in a ticket purchasing system of a public transportation means, a blacklist object in a blacklist request table may be an illegal and belief-losing person registered in the table, and the travel range of the illegal and belief-losing person needs to be limited; in a payment system such as water and electricity, the blacklist object in the blacklist request list may be an object which does not pay water fees or electricity fees for a long time, and the user needs to prompt the user to pay fees to a service unit for providing water and electricity. The object in the white list request table can be a high-level object of a bank or an operation and maintenance person of the current target service system. And correspondingly configuring a blacklist request list and a whitelist request list according to actual requirements of different service systems.
Based on the current real-time flow control strategy, the target service system acquires a blacklist request table and a whitelist request table, and identifies the request identity of the current target access request according to the blacklist request table and the whitelist request table. The above mentioned object access request may carry the relevant identification characterizing the object or terminal, according to which the identity matching may be performed in a black and white request table. If the object or terminal represented by the current target access request is neither in the blacklist request table nor the whitelist request table, the target access request is processed according to the current real-time flow control strategy. When the target access request is a white list request, the current limiting state of the target access request is directly determined to be an accessible state, namely the current target access request is normally processed no matter how the comprehensive response level of the current target system is. Otherwise, when the target access request is a blacklist request, determining that the current limit state of the target access request is an inaccessible state.
Further combining the system maintenance information, the method for controlling the flow of the target service system according to the real-time flow control strategy further comprises the following steps: the object or terminal in the blacklist request table cannot access the target service system in any time period, and the whitelist object in the whitelist request table can access the target service system in any time period.
In other embodiments, the special event information of the target business system further includes a maximum number of requests that the target business system can support per unit time. It should be noted that, the maximum number of requests supportable in the unit time is mainly configured by management operation staff of the service system, and the maximum number of requests may be related to the number of staff members of the bank, the saturation of staff member work, the staff member processible service, and the like. It will be appreciated that since the hardware performance of the service system is the basis for handling access requests, the maximum number of requests that can be supported per unit time should be less than the actual QPS that the hardware of the service system can handle.
The maximum number of requests may be used as a reference for the target business system to formulate traffic opening thresholds for different time nodes. The traffic opening threshold refers to the maximum number of access requests that the target service system can receive under each time node, formulated with reference to the real-time QPS and the maximum number of requests. While the set of traffic opening thresholds at different time nodes is referred to as the traffic opening threshold set. The flow opening threshold may be engaged in the flow control process of the target business system as part of a real-time flow control strategy. For example, under a real-time flow control strategy, determining a current corresponding flow opening threshold value of the target service system from a flow opening threshold value set, and determining that the current limiting state of the target access request is an inaccessible state when the current access quantity of the target service system is greater than the current flow opening threshold value, which indicates that the current access quantity exceeds the upper limit of the access flow which can be carried by the target service system. Otherwise, when the current access amount of the target service system is smaller than or equal to the current flow opening threshold, the target service system is considered to be capable of continuing to bear more access amount, and the current limiting state of the target access request is determined to be an accessible state, so that the target service system processes the current target access request.
Therefore, the configuration of the special event information is equivalent to that before the real-time flow control strategy is implemented, the target access request is pre-screened, and the target access request which is not required to be processed or can be directly processed is screened through the special event information, so that the effects of saving the computing power resource of the service system to a certain extent and improving the processing efficiency of the service system can be achieved.
In combination with one or more of the above embodiments, the present application provides a flow control method, unlike the solution of curing flow control in the related art, which is actually provided by the present embodiment of the present invention. According to the embodiment of the invention, the historical access condition information which can characterize the processing condition of the access request by the target service system is firstly obtained, and the comprehensive health degree information is calculated according to the historical access condition information, so that the processing capability of the access request by the target service system can be comprehensively reflected, and reliable data support is provided for the formulation of a real-time flow control strategy. And over time, the server can continuously acquire the historical access condition information to calculate new comprehensive health information, so that dynamic updating of the real-time flow control strategy is completed, and the target service system can still adapt to the speed of updating iteration of the hardware performance of the Internet under the condition that the system is continuously optimized, updated and upgraded, and the maximum processing capacity is exerted as much as possible. In addition, the flow control method provided by the embodiment of the invention can automatically adjust according to the comprehensive health degree information of the current service system, does not need to manually set and modify the upper limit of the access quantity of the service system or even a single service, and can well improve the running stability and the running efficiency of the service system. Furthermore, the embodiment of the invention also provides the method for calculating the comprehensive health degree information by integrating the independent health degree information under different time dimensions, so that the influence of the response level of the target service system under different time dimensions on the current comprehensive response level can be comprehensively considered, the calculation precision and accuracy of the comprehensive health degree information are further improved, and the purposes of improving the scientificity and accuracy of the real-time flow control strategy are realized. In addition, in consideration of the special working interval of the target service system in the actual application scene, such as inaccessible system maintenance time, a black-and-white list of the system and the like, the target access request is pre-screened by acquiring pre-configured special event information on the basis of the real-time flow control strategy, so that the processing efficiency of the target service system on the target access request is further improved.
Through the above, the embodiment of the invention provides a flow control method capable of maintaining normal and stable operation of a target service system to a certain extent. However, in the practical application scenario, there is still a risk of failure in the service system, and there is also a possibility that the service is suddenly stopped. For example, a banking system may need to update a service version outside of the system maintenance time during which the banking system is not able to provide service. Or, the banking system is restarted after downtime due to software or hardware faults, so that the access request before downtime is invalid. Or, the server of the banking system fails due to the unreliability factors such as power failure, flood and the like, and the server can be on line again to provide service after the system is repaired. In addition to the above failure, the newly-online service system does not pass a large number of access tests, and the processing capacity is fragile. In the above-mentioned case, after the update or maintenance, the target service system is vulnerable in the first period of time of re-online, and if the normal request processing capacity is restored immediately, there is a high possibility that the target service system is repaired or the update is failed again soon. In order to solve the above problems, the embodiments of the present invention continuously propose a "flow climbing strategy" of a target service system after a fault is recovered on the basis of a real-time flow control strategy, which is specifically described below.
Referring to fig. 4, fig. 4 is a flowchart illustrating steps of a target service system recovery method according to an embodiment of the present invention, where the method is applied to the server 102 in fig. 1, and the method specifically includes, but is not limited to, steps S400-S410.
S400, when the target service system is in a disconnection state, continuously sending a probe request to the target service system until the target service system is determined to restore the connection state according to the received response information of the target service system;
specifically, according to the above, the target service system may be in a disconnected state due to system update, system downtime, or hardware failure. The disconnection state refers to a state that the current target service system cannot be accessed, and the connection state refers to a state that the current target service system can be accessed. When the target service system is in the disconnection state, the server continuously sends a probe request to the target service system. For example, every 30 seconds, the server sends a probe request to the target service system, and if the target service system is currently in a disconnected state, the server cannot receive any response returned by the target service system. Thus, when the server receives the target service system response information, it can be determined that the target service system has been disconnected from the disconnected state and restored to the connected state. Thus, the server determines that the target business system can begin processing access requests.
S410, according to a preset flow opening threshold set, access requests corresponding to all flow opening thresholds are sequentially sent to a target service system; the flow opening threshold value set comprises a plurality of flow opening threshold values under different time nodes, and each flow opening threshold value is used for representing the maximum number of access requests receivable by the target service system under each time node;
specifically, in the above description, according to the comprehensive health information of the target service system, an appropriate real-time flow control policy may be formulated for the target service system to perform flow control of the target access request. However, the comprehensive health information of the target business system is calculated according to the historical access state information. If the target service system is recovered from the disconnection state to the connection state, the target service system may be used on line for the first time without history access state information; still alternatively, the target business system may have been version updated, and both throughput and processing power of the target business system may change, so that the historical access state information prior to entering the disconnected state may not be able to reflect the new processing performance of the target business system. Therefore, in the case that the comprehensive health degree information cannot be calculated according to the historical access state information, the server cannot formulate a real-time flow control strategy for the current target service system. Therefore, protecting the target service system from being disconnected again from the connection state due to excessive flow pressure becomes a primary goal of maintaining stable operation of the target service system, and how to determine the initial flow of the target service system after the recovery of the connection state becomes a key.
It is mentioned in the foregoing that, based on the actual QPS of the server (if the actual QPS cannot be calculated from the integrated health information currently, the actual QPS may be replaced by the maximum QPS of the server) and the maximum number of requests, a traffic opening threshold set can be measured, and in some embodiments, the maximum traffic opening threshold in the traffic opening threshold set may be set to be the maximum QPS of the server. The flow opening threshold value set comprises a plurality of flow opening threshold values under different time nodes, and the flow opening threshold values are sequentially used as the maximum number of access requests receivable by the target service system under each time node according to the sequence from small to large of the flow opening threshold values in the flow opening threshold value set, so that the purpose of controlling the flow condition of the target service system after the connection state is recovered through the flow opening threshold value set is achieved. It can be thought that, because the target service system receives the access request according to the flow opening threshold standard from small to large, the server can start to evaluate the new processing performance of the target service system according to the processing conditions of the target service system on the access request at different time nodes, and collect enough historical access condition data after the target service system enters a normal running state, and restart to realize dynamic flow control on the target service system.
For example, after the target service system resumes the connection state, the minimum first traffic opening threshold is selected from the traffic opening threshold set as the current traffic opening threshold, and because the traffic opening threshold is used for representing the maximum number of access requests receivable by the target service system under the current time node, the first access request set smaller than the current traffic opening threshold is sent to the target service system that resumes the connection state. The flow opening threshold in the flow opening threshold set may be a plurality of flow opening thresholds empirically set, or may be expressed as a percentage of the maximum flow opening threshold in the flow opening threshold set. For example, the flow opening threshold is 10%, 20%. 100% of the maximum flow opening threshold in order from small to large.
It can be understood that if the target service system is a new system that is operated online for the first time, the first access request set is a new access request sent by the terminal system. If the target service system is an old system which is online operated after being repaired or updated, the first access request set can be a new access request sent by the terminal system, and the access request received in the disconnection state of the target service system is invalidated; or the first access request set comprises access requests received when the target service system is in the disconnection state, the access requests are temporarily stored in a storage space such as a message sequence and the like during the disconnection state of the target service system, and the access requests are sequentially divided into the first access request set after the target service system is restored to the connection state and are sequentially processed by the target service system. Of course, if the number of backlogged access requests is smaller, the first access request set may further include the backlogged old access request and the new access request after the connection state is restored. The target business system first processes access requests in the first set of access requests.
In order to judge the current processing performance of the target service system, in the process that the target service system processes the first access request set with a smaller access number, the server continuously records the processing state of the target service system on the request in the first access request set, such as time consumption of access processing, success or failure of access processing and the like. And determining the ratio of the number of successfully processed requests in the first access request set to the total number of requests in the first access request set as the request processing success rate. In order to measure whether the current target service system can enter the next processing stage or not and can accept more access requests, a target ratio corresponding to a flow opening threshold is set. The target ratio is used to characterize the lowest request processing success rate that the target business system can take the next traffic opening threshold value larger than the current traffic opening threshold value as the current traffic opening threshold value. In this way, when the request processing success rate of the first access request set meets the target ratio, it is indicated that the current target service processing system can well cope with the number of access requests corresponding to the current traffic opening threshold, and more access request numbers can be opened for processing by the target service processing system. For example, the current flow opening threshold is 10% of the maximum flow opening threshold, and the corresponding target ratio is set to be 99%, when the request processing success rate in the first access request set meets 99%, that is, is equal to or greater than 99%, according to the threshold value in the flow opening threshold set, the maximum access request number receivable by the target service system in the next time period is represented by selecting a second flow opening threshold value greater than the first flow opening threshold value according to the order from small to large, and the second access request set meeting the current flow opening threshold value is continuously sent to the target service system for access request processing. Similarly, the number of requests in the second set of access requests should be less than the current second traffic opening threshold. And by analogy, assuming that the current second traffic opening threshold value is 20% of the maximum traffic opening threshold value, and correspondingly setting the target ratio to be 99%, when the request processing success rate in the second access request set meets 99%, continuing to select the next second traffic opening threshold value larger than the current traffic opening threshold value as the traffic opening threshold value of the next time period until the maximum traffic opening threshold value in the traffic opening threshold value set is used as the current traffic opening threshold value, namely, the target service system is enabled to completely run according to the standard of the maximum traffic opening threshold value, and receiving the maximum access request number corresponding to the maximum traffic opening threshold value for processing.
In the foregoing, in describing that the target service system performs service access request processing sequentially with the number of access requests corresponding to the traffic opening thresholds in the traffic opening threshold set at different time nodes, for example, the traffic opening thresholds in the traffic opening threshold set may be regularly increased, for example, the traffic opening thresholds are sequentially 10% and 20% of the maximum traffic opening thresholds from small to large. In combination with the actual application scenario, it is not difficult to find that if the target service system is an old system that is repaired or updated, the capability of processing the access request is generally not worse than before, but the previous processing level is maintained or is improved to a certain extent on the basis of the original processing level. Therefore, if the flow opening threshold value increased according to the rule is used to "slowly probe" the processing performance of the repaired or updated target service system, the time spent in this process is relatively long, so that the overall efficiency of the target service system for recovering from the disconnection state to the normal working state is reduced, and a considerable backlog of access requests is generated. For some target service systems with higher service timeliness requirements, the longer recovery stage also affects the use experience of the object to a greater extent. Therefore, on the basis that the access request processing capacity of the target service system is gradually released by using the flow opening threshold, the embodiment of the invention provides a method for recovering the target service system, which is started quickly and lifted slowly.
Referring to fig. 5, fig. 5 is a schematic diagram of a method for recovering a target service system with "fast start and slow lift" according to an embodiment of the present invention. For example, the maximum traffic opening threshold is set as the maximum QPS of the server, and it should be noted that the maximum traffic opening threshold is set as the maximum QPS of the server, and the maximum QPS should be the latest maximum QPS after the server is updated and repaired. As shown in fig. 5, the abscissa is the time axis after the target service system enters the connected state, and the left to right indicates the increase of the recovery time; and the ordinate indicates the ratio of the number of access requests receivable by the target service system at different time nodes to the maximum QPS. Referring to fig. 5, the "fast start" refers to selecting a smaller traffic opening threshold value from traffic opening thresholds as the maximum target of the target traffic system for processing the access request in the first period of time when the target traffic system is restored from the disconnected state to the connected state, firstly selecting 10% of the maximum QPS as the current traffic opening threshold value, and testing whether the target traffic system is available, where, as shown in fig. 5, point a indicates that the amount of access request that can be processed by the target traffic system before the first time node is 10% of the maximum QPS. After the request processing success rate of the first access request set meets the target ratio, the next selected traffic opening threshold should be much larger than the current first traffic opening threshold, for example, in fig. 5, the embodiment of the present invention selects the traffic opening threshold in the next period of time as the second traffic opening threshold, which is 70% of the maximum QPS. This is so because of the mention in the above: after the target service system is repaired or updated, the general processing capacity is maintained stable or is increased to some extent, so that after the first access request set test determines that the current target service system is available, a larger flow opening threshold can be released, the starting process of the target service system is accelerated, and the processing efficiency of the target service system from the disconnection state to the normal working state is improved. As shown in fig. 5, point B represents that between the first time node and the second time node, the amount of access requests that the target business system can handle is 70% of the maximum QPS. The more the number of access requests processed by the target service system is, the closer the access requests are to the maximum number of access requests that the target service system can process (i.e. under the condition of maximum QPS), the higher the difficulty of maintaining the stable operation of the target service system is, therefore, after the stage of "fast start" is completed, the flow control of the target service system should enter a "slow-up" state, and the target service system can gradually adapt to the larger number of access requests by using a relatively slow flow opening threshold change, so as to avoid the target service system from being trapped into a down state again. As shown in fig. 5, point C indicates that the amount of access requests that the target service system can process between the second time node and the third time node is 80% of the maximum QPS, which is only 10% higher than 70% of the maximum QPS in the previous time interval. In the next time interval, namely, between the third time node and the fourth time node, the D point indicates that the access request amount which can be processed by the target service system is 85% of the maximum QPS, the fluctuation of the flow opening threshold is again reduced, and the slow lifting stage is realized as much as possible, wherein the lifting rate of the current flow opening threshold is smaller than that of the flow opening threshold in the previous time interval. And the like, until the maximum flow opening threshold is selected as the time node of the current flow opening threshold, enabling the target service system to bear the maximum access request quantity. In this state, the target service system can calculate and obtain comprehensive health degree information according to the historical access condition information, and finally make a real-time flow control strategy, and perform dynamic flow control on the target access request in the normal working process of the target service system.
Through the steps S400-S410, the embodiment of the present invention provides a whole process of controlling the target service system to recover from the disconnection state to the normal working state through the flow opening threshold set when the target service system is in a fault state and then is recovered from the disconnection state to the connection state, or when the target service system is on line for the first time, so that the target service system can stably enter the normal working state, and the target service system is prevented from being in a fault again due to excessive access requests. In addition, according to the actual repair and update conditions of the target service system, a 'quick start and slow lifting' recovery scheme is provided, so that the recovery efficiency of the target service system is improved, the risk that the target service system falls into a disconnection state again is reduced, and the stable operation of the target service system is positively influenced.
In summary, in the flow control method provided by the embodiment of the present invention, a server first configures special event information of a target service system, and determines that a target access request is not received in a system maintenance period of the target service system, or that the target access request is not received when the number of target access requests exceeds the maximum number of requests. In addition, the target request is pre-screened according to the blacklist request table and the whitelist request table. In the normal operation process of the target service system, the server continuously updates the comprehensive health degree information of the target service system under different time dimensions through the continuously acquired historical access request information, and formulates a dynamically-changed real-time flow control strategy according to the comprehensive health degree information, and performs flow control on the target access request according to the real-time flow control strategy. The flow control method does not need to manually configure the upper limit of the access amount, has high efficiency and high instantaneity, and can be well adapted to the updating iteration speed of the current internet technology. The real-time flow control strategy is specified by the comprehensive health degree information of different time dimensions, so that the scientificity and the accuracy of the real-time flow control strategy are improved. When the target service system encounters a fault and falls into a disconnection state, the server continuously sends a heuristic request to the target service system to timely confirm whether the target service system is restored to a connection state, after the target service system is restored to the on-line state, the flow opening threshold value set is used for controlling the restoration process of the target service system, and a 'fast start and slow ramp-up' restoration strategy is adopted to improve the restoration efficiency of the target service system, reduce the risk of the target service system being failed again and further improve the operation stability of the target service system.
In the following, a banking system is taken as an example, and an implementation process of the flow control method in the banking system according to the embodiment of the present invention is described.
Referring to fig. 6, fig. 6 is a schematic diagram of a flow control system according to an embodiment of the present invention. As shown in fig. 6, the system may be provided in a server for implementing dynamic flow control of a target service system. The system comprises a health degree detection module, a current limiting strategy layer, a data storage layer, a flow control layer, a bank service access layer, a service private line and bank service.
The health detection module is used for continuously collecting bank request data reported by the bank service access layer, wherein the bank request data is historical access condition data corresponding to the target access request in the content. Referring to the following table 2, table 2 is a table of processing results of a bank access request according to an embodiment of the present invention.
TABLE 2
As shown in table 2 above, the processing results of the bank request data are stored in a plurality of fields such as bank_type, line_ name, succ, use _time, req_time, etc., and the data of each field corresponds to the data types such as string, int, datatime, etc., respectively. For example, bank_type stores bank type information; line_name stores the name of the special line of the banking service; the succ stores data of 1 or 0,1 indicating that the access is successful, and 0 indicating that the access is failed; use_time stores the request time and req_time stores the request time. In a form similar to table 2 above, the health detection module stores the collected banking request data in the data layer, and calculates and updates the comprehensive health information of the banking dedicated line at regular time, which can be the data support of the dynamic flow restriction module of the flow control layer.
The current limiting policy layer comprises a current limiting configuration management end and a management timer. And the management operation and maintenance personnel configures the current limiting strategies of a plurality of banks (such as bank A, bank B and bank C.) in the current banking system through the limiting configuration management end. Unlike the real-time flow control strategy in the above embodiments, the flow restriction strategy here is actually special time information in the above. That is, the current limit policy includes announcement time data of each bank (during the announcement time, the banking system does not receive the access request, and thus the announcement time herein is actually equivalent to the system maintenance information in the above content), black-and-white list data (i.e., the blacklist request table and the whitelist request table in the above content), and current limit configuration data (i.e., the maximum number of requests per unit time in the above content). The management timer is used for synchronizing the current limiting strategy to the CKV through the NTP service timing according to the current limiting strategy of the current limiting configuration management end and the comprehensive health degree information of the health monitoring module, so that the flow control layer can conveniently and quickly acquire the current limiting data in the current limiting strategy. The restriction data refers to announcement time data, black-and-white list data and restriction configuration data in the restriction policy.
The data storage layer comprises a relational database MySQL and a memory database CKV, wherein the MySQL stores and manages the current limiting strategy configured by operation and maintenance personnel and the comprehensive health degree information of the special banking lines, and the current limiting data of each special banking line is stored in the CKV for the flow control layer to rapidly acquire.
The flow control layer comprises an announcement system module, a black-and-white list module, a dynamic current limiting module and other data modules, wherein the announcement system module is used for acquiring announcement time of a bank, the black-and-white list module is used for acquiring black-and-white list data, the dynamic current limiting module is used for acquiring current limiting configuration data, and the other data modules are used for acquiring other data except the current limiting data. According to the current limiting data and the comprehensive health information, the flow control layer determines the current limiting state of each bank access request according to a preset strategy, wherein the current limiting state is accessible or inaccessible, so that whether the bank access request can be received and processed by the banking system is determined.
The bank service access layer is a proxy layer for the server to access each bank transfer line, and is mainly used for shielding the policy logic of the access bank, reporting the results of the bank request of the access bank and time-consuming data (namely the historical access status information in the content) to the health detection module, and calculating the comprehensive health information of each bank service special line by the health detection module.
The service private line refers to a private access network between the server and each bank, and the bank service refers to a business service system of each bank.
The flow of accessing the banking system is described in conjunction with the architecture diagram of the flow control system shown in fig. 6 and with fig. 7. Fig. 7 is a flowchart of the steps for accessing a banking system. Firstly, an object accesses a banking service through internet banking software in a mobile terminal such as a mobile phone or a banking staff accesses the banking service through terminal equipment such as a computer, firstly, the request triggers a current limiting service, the current limiting service is supported by a flow control layer in fig. 6, whether a current banking system can be accessed or not is judged according to the current limiting service, if the current limiting service appears, the object is a blacklist object or the banking system is in an announcement time, or the number of access requests received by the banking system exceeds the current limiting configuration of the system, and the like, the current banking system is determined to be inaccessible, and an access failure message is returned to the terminal equipment. If the current banking system is determined to be accessible, the banking access request enters banking service through a banking service access layer, the banking service system processes the banking access request, after the banking access request is processed, the banking service returns an accessed processing result to the terminal equipment, and the accessed processing result is continuously reported to a health degree checking module, so that the health degree checking module continuously updates the health state of the banking system, and a dynamic current limiting strategy is adjusted.
Referring to fig. 8, fig. 8 is a schematic structural diagram of a server according to an embodiment of the present invention, where the server corresponds to the server 102 shown in fig. 1, and the server may implement the steps in the flow control method described above through hardware or a combination of hardware and software. As shown in fig. 8, the server may include:
a first module 810, configured to obtain historical access status information of the target service system every time a preset duration elapses; the historical access condition information is used for representing the flow condition of the accessed target service system;
a second module 820 for determining comprehensive health information of the target business system in a plurality of different time dimensions according to the historical access condition information; the comprehensive health information is used for representing the comprehensive response level of the target service system;
a third module 830, configured to determine a real-time flow control policy of the target service system according to the integrated health information;
a fourth module 840 is configured to perform flow control on the target access request according to the real-time flow control policy.
In some embodiments, the first module comprises at least one of:
a first unit, configured to obtain initiation time information of an access request of a target service system in a historical time period;
A second unit, configured to obtain time-consuming information of an access request of the target service system in a historical time period;
a third unit, configured to obtain access success/failure information of an access request of the target service system in a historical time period;
a fourth unit, configured to obtain object information of an access request of a target service system in a historical time period, where the object information includes an identifier of the service system to be requested and an identifier of a current access request;
and a fifth unit, configured to obtain the total number of access requests for the target service system in the history period.
In some embodiments, the second module comprises:
a sixth unit, configured to calculate average time-consuming information of the target service system and unit time statistics information of the target service system in different time dimensions according to the historical access status information;
a seventh unit, configured to calculate, according to the average time-consuming information and the unit time statistics information in different time dimensions, independent health degree information in each time dimension;
and an eighth unit, configured to calculate and obtain comprehensive health degree information according to the independent health degree information in each time dimension.
In some embodiments, the sixth unit comprises:
A ninth unit, configured to calculate a total request amount of the target service system in a unit time according to a total number of access requests of the target service system in the historical time period;
a tenth unit, configured to calculate a successful request amount of the target service system in a unit time according to access success/failure information of an access request of the target service system in a historical time period;
an eleventh unit, configured to calculate average time consumption of the target service system in a unit time according to time consumption information of the access request for the target service system in the historical time period;
and the twelfth unit is used for calculating the duty ratio coefficient of the successful request quantity according to the total request quantity of the target service system in unit time and the successful request quantity of the target service system in unit time.
In some embodiments, the seventh unit comprises:
and the thirteenth unit is used for calculating and obtaining the independent health degree information under each time dimension according to the average time consumption information of the target service system under the historical access condition, the total request amount of the target service system in unit time, the successful request amount in unit time, the average time consumption in unit time and the duty ratio coefficient of the successful request amount.
In some embodiments, the eighth unit comprises:
a fourteenth unit, configured to configure a weight threshold of the independent health degree information in each time dimension; the weight threshold value of the independent health degree information is used for representing the influence degree of the current independent health degree information on the comprehensive health degree information;
a fifteenth unit, configured to perform weighted calculation on each independent health degree information according to a weight threshold value of each independent health degree information, so as to obtain comprehensive health degree information; the weight threshold value of the independent health degree information in the time dimension close to the current moment is larger than the weight threshold value of the independent health degree information in the time dimension far from the current moment.
In some embodiments, the server may further include:
a fifth module, configured to determine a preset query rate coefficient per second corresponding to the health degree interval according to the health degree interval in which the comprehensive health degree information is located;
a sixth module, configured to calculate an actual query rate per second of the target service system according to the maximum query rate per second of the target service system and a preset query rate per second coefficient;
and a seventh module, configured to determine a real-time flow control policy of the target service system according to the actual query rate per second of the target service system.
In some embodiments, the server may further include:
an eighth module, configured to continuously send a probe request to the target service system when the target service system is in a disconnection state, until it is determined that the target service system resumes the connection state according to the received response information of the target service system;
a ninth module, configured to sequentially send access requests corresponding to the flow opening thresholds to the target service system according to a preset flow opening threshold set; the traffic opening threshold set comprises a plurality of traffic opening thresholds under different time nodes, and each traffic opening threshold is used for representing the maximum number of access requests receivable by the target service system under each time node.
In some embodiments, the ninth module comprises:
sixteenth unit, configured to select a first traffic opening threshold with minimum traffic opening threshold from the traffic opening threshold sets as a current traffic opening threshold, and send a first access request set smaller than the number of the current traffic opening threshold to a target service system that recovers the connection state;
a seventeenth unit, configured to, when the request processing success rate of the first access request set meets a target ratio, sequentially select, according to a threshold size, a second traffic opening threshold that is greater than the first traffic opening threshold from the traffic opening threshold sets as a current traffic opening threshold, and send, to the target service system, the second access request set that meets the current traffic opening threshold until a maximum traffic opening threshold in the traffic opening threshold sets is used as the current traffic opening threshold.
In some embodiments, the server may further comprise at least one of:
a tenth module, configured to configure system maintenance information of the target service system; the system maintenance information is used for representing inaccessible time of the target business system;
an eleventh module, configured to configure a blacklist request table and a whitelist request table of the target service system, where the access request in the blacklist request table is configured to be inaccessible to the target service system, and the access request in the whitelist request table is configured to be accessible to the target service system;
and a twelfth module, configured to configure a maximum number of requests that can be supported by the target service system in a unit time.
In some embodiments, the server may further comprise at least one of:
a thirteenth module, configured to obtain a current flow opening threshold of the target service system according to the real-time flow control policy, and determine that the current limiting state of the target access request is an inaccessible state when the current access amount of the target service system is greater than the current flow opening threshold; when the current access quantity of the target service system is smaller than or equal to the current flow opening threshold value, determining that the current limiting state of the target access request is an accessible state;
A fourteenth module, configured to obtain a blacklist request table and a whitelist request table of the target service system according to the real-time flow control policy, identify a request identity of a target access request according to the blacklist request table and the whitelist request table, and determine that a current limit state of the target access request is an accessible state when the target access request is a whitelist request; when the target access request is a blacklist request, determining that the current limiting state of the target access request is an inaccessible state;
and a fifteenth module, configured to perform flow restriction control on the target access request according to the flow restriction state of the target access request.
In summary, the server provided by the embodiment of the invention acquires the historical access condition information of the target service system at intervals to master the accessed real-time flow condition of the target service system, further calculates the comprehensive health information of the target service system, determines the real-time flow control strategy and completes the flow control of the target access request. In addition, the method and the system can determine the comprehensive health degree information of the target service system in a plurality of different time dimensions according to the historical access condition information, and determine the real-time flow control strategy by combining the comprehensive response levels of the target service system in a plurality of different time dimensions, so that the real-time flow control strategy can reflect the influence degrees of different time dimensions, and the accuracy of the real-time flow control strategy is further improved.
The embodiment of the invention also provides electronic equipment, which comprises a processor and a memory;
the memory stores a program;
the processor executes a program to perform the flow control method of the server 102 shown in fig. 2.
The electronic device has a function of controlling a flow rate of a target access request of a target service system, for example, a personal computer, a mobile phone, a smart phone, a personal digital assistant, a wearable device, a palm computer, a tablet computer and the like.
In an embodiment of the present invention, the electronic device includes a processor having the following functions:
acquiring historical access condition information of a target service system every time a preset time length passes; the historical access condition information is used for representing the flow condition of the accessed target service system;
determining comprehensive health degree information of a target service system in a plurality of different time dimensions according to the historical access condition information; the comprehensive health information is used for representing the comprehensive response level of the target service system;
determining a real-time flow control strategy of a target service system according to the comprehensive health degree information;
and controlling the flow of the target access request according to the real-time flow control strategy.
Embodiments of the present invention also disclose a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The computer instructions may be read from a computer-readable storage medium by a processor of a computer device, and executed by the processor, cause the computer device to perform the flow control method described above.
In some alternative embodiments, the functions/acts noted in the block diagrams may occur out of the order noted in the operational illustrations. For example, two blocks shown in succession may in fact be executed substantially concurrently or the blocks may sometimes be executed in the reverse order, depending upon the functionality/acts involved. Furthermore, the embodiments presented and described in the flowcharts of the present invention are provided by way of example in order to provide a more thorough understanding of the technology. The disclosed methods are not limited to the operations and logic flows presented herein. Alternative embodiments are contemplated in which the order of various operations is changed, and in which sub-operations described as part of a larger operation are performed independently.
Furthermore, while the invention is described in the context of functional modules, it should be appreciated that, unless otherwise indicated, one or more of the functions and/or features may be integrated in a single physical device and/or software module or may be implemented in separate physical devices or software modules. It will also be appreciated that a detailed discussion of the actual implementation of each module is not necessary to an understanding of the present invention. Rather, the actual implementation of the various functional modules in the apparatus disclosed herein will be apparent to those skilled in the art from consideration of their attributes, functions and internal relationships. Accordingly, one of ordinary skill in the art can implement the invention as set forth in the claims without undue experimentation. It is also to be understood that the specific concepts disclosed are merely illustrative and are not intended to be limiting upon the scope of the invention, which is to be defined in the appended claims and their full scope of equivalents.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method of the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
Logic and/or steps represented in the flowcharts or otherwise described herein, e.g., a ordered listing of executable instructions for implementing logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device.
More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium may even be paper or other suitable medium upon which the program is printed, as the program may be electronically captured, via, for instance, optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner, if necessary, and then stored in a computer memory.
It is to be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above-described embodiments, the various steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, may be implemented using any one or combination of the following techniques, as is well known in the art: discrete logic circuits having logic gates for implementing logic functions on data signals, application specific integrated circuits having suitable combinational logic gates, programmable Gate Arrays (PGAs), field Programmable Gate Arrays (FPGAs), and the like.
In the description of the present specification, a description referring to terms "one embodiment," "some embodiments," "examples," "specific examples," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present invention. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiments or examples. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
While embodiments of the present invention have been shown and described, it will be understood by those of ordinary skill in the art that: many changes, modifications, substitutions and variations may be made to the embodiments without departing from the spirit and principles of the invention, the scope of which is defined by the claims and their equivalents.
While the preferred embodiment of the present invention has been described in detail, the present invention is not limited to the embodiments, and those skilled in the art can make various equivalent modifications or substitutions without departing from the spirit of the present invention, and these equivalent modifications or substitutions are included in the scope of the present invention as defined in the appended claims.
Claims (15)
1. A flow control method, comprising:
acquiring historical access condition information of a target service system every time a preset time length passes; the historical access condition information is used for representing the flow condition of the accessed target service system;
according to the historical access condition information, independent health degree information of the target service system in a plurality of different time dimensions is determined, and comprehensive health degree information of the target service system is determined according to each independent health degree information; each piece of independent health degree information is used for representing the response level of the target service system in a corresponding time dimension, and the comprehensive health degree information is used for representing the comprehensive response level of the target service system; the influence degree of the independent health degree information under different time dimensions on the determination of the comprehensive health degree information is different;
determining a real-time flow control strategy of the target service system according to the comprehensive health degree information;
and controlling the flow of the target access request according to the real-time flow control strategy.
2. The flow control method according to claim 1, wherein the obtaining historical access condition information of the target service system includes at least one of:
Acquiring the initiating time information of the access request of the target service system in the historical time period;
or, time-consuming information of the access request of the target service system in the historical time period is obtained;
or, obtaining the access success or failure information of the access request of the target service system in the historical time period;
or, obtaining object information of the access request of the target service system in a historical time period, wherein the object information comprises an identifier of the service system to be requested and an identifier of the current access request;
or, obtaining the total number of access requests for the target service system in the history period.
3. The flow control method according to claim 2, wherein determining independent health information of the target service system in a plurality of different time dimensions according to the historical access condition information, and determining comprehensive health information of the target service system according to each independent health information, comprises:
calculating average time consumption information of the target service system and unit time statistical information of the target service system under different time dimensions according to the historical access condition information;
Calculating to obtain independent health degree information in each time dimension according to the average time consumption information and the unit time statistical information in different time dimensions;
and calculating the comprehensive health degree information according to the independent health degree information in each time dimension.
4. A flow control method according to claim 3, wherein said calculating statistical information of unit time of said target service system in different time dimensions based on said historical access condition information comprises:
according to the total number of access requests of the target service system in the historical time period, calculating the total request amount of the target service system in unit time;
according to the access success and failure information of the access request of the target service system in the historical time period, calculating the successful request quantity of the target service system in unit time;
calculating average time consumption of the target service system in unit time according to the time consumption information of the access request of the target service system in the historical time period;
and calculating the duty ratio coefficient of the successful request quantity according to the total request quantity of the target service system in unit time and the successful request quantity of the target service system in unit time.
5. The flow control method according to claim 4, wherein the calculating to obtain the independent health degree information in each time dimension according to the average time consumption information and the statistical information of unit time in the different time dimensions includes:
and calculating to obtain independent health degree information under each time dimension according to the average time consumption information of the target service system under the historical access condition, the total request quantity of the target service system in unit time, the successful request quantity in unit time, the average time consumption in unit time and the duty ratio coefficient of the successful request quantity.
6. The flow control method according to any one of claims 3-5, wherein the calculating the integrated health information according to the independent health information in each time dimension includes:
configuring weight thresholds of independent health degree information under each time dimension; the weight threshold value of the independent health degree information is used for representing the influence degree of the current independent health degree information on the comprehensive health degree information;
weighting calculation is carried out on each independent health degree information according to the weight threshold value of each independent health degree information, so that the comprehensive health degree information is obtained;
The weight threshold value of the independent health degree information in the time dimension close to the current moment is larger than the weight threshold value of the independent health degree information in the time dimension far from the current moment.
7. The method according to claim 1, wherein determining the real-time traffic control policy of the target service system according to the integrated health information comprises:
determining a preset query rate coefficient per second corresponding to the health degree interval according to the health degree interval in which the comprehensive health degree information is located;
calculating the actual query rate per second of the target service system according to the maximum query rate per second of the target service system and the preset query rate per second coefficient;
and determining a real-time flow control strategy of the target service system according to the actual query rate per second of the target service system.
8. A method of flow control according to claim 1, wherein the method further comprises:
when the target service system is in a disconnection state, continuously sending a probe request to the target service system until the target service system is determined to restore the connection state according to the received response information of the target service system;
According to a preset flow opening threshold set, sequentially sending access requests corresponding to all flow opening thresholds to the target service system; the traffic opening threshold set comprises a plurality of traffic opening thresholds under different time nodes, and each traffic opening threshold is used for representing the maximum number of access requests receivable by the target service system under each time node.
9. The method for controlling traffic according to claim 8, wherein the sequentially sending access requests corresponding to the traffic opening thresholds to the target service system according to the preset traffic opening threshold set includes:
selecting a minimum first traffic opening threshold from the traffic opening threshold sets as a current traffic opening threshold, and sending a first access request set smaller than the number of the current traffic opening threshold to the target service system in a connection state recovery state;
when the request processing success rate of the first access request set meets a target ratio, sequentially selecting a second flow opening threshold value larger than the first flow opening threshold value from the flow opening threshold value sets according to a threshold value as a current flow opening threshold value, and sending the second access request set meeting the current flow opening threshold value to the target service system until the maximum flow opening threshold value in the flow opening threshold value sets is used as the current flow opening threshold value.
10. A method of flow control according to claim 1, wherein the method further comprises at least one of:
configuring system maintenance information of the target service system; wherein the system maintenance information is used to characterize the inaccessible time of the target business system;
or configuring a blacklist request table and a whitelist request table of the target service system, wherein the access request in the blacklist request table is configured to be inaccessible to the target service system, and the access request in the whitelist request table is configured to be accessible to the target service system;
or configuring the maximum number of the requests which can be supported by the target service system in unit time.
11. The flow control method according to claim 1, wherein said flow controlling the target access request according to the real-time flow control policy comprises at least one of:
acquiring a current flow opening threshold of the target service system according to the real-time flow control strategy, and determining that the current limiting state of the target access request is an inaccessible state when the current access quantity of the target service system is larger than the current flow opening threshold; when the current access quantity of the target service system is smaller than or equal to the current flow opening threshold value, determining that the current limiting state of the target access request is an accessible state;
Or acquiring a blacklist request list and a whitelist request list of the target service system according to the real-time flow control strategy, identifying the request identity of the target access request according to the blacklist request list and the whitelist request list, and determining that the current limiting state of the target access request is an accessible state when the target access request is a whitelist request; when the target access request is a blacklist request, determining that the current limiting state of the target access request is an inaccessible state;
and controlling the flow of the target access request according to the current limiting state of the target access request.
12. A server, comprising:
the first module is used for acquiring historical access condition information of the target service system every time a preset time length passes; the historical access condition information is used for representing the flow condition of the accessed target service system;
the second module is used for determining independent health degree information of the target service system under a plurality of different time dimensions according to the historical access condition information, and determining comprehensive health degree information of the target service system according to each independent health degree information; each piece of independent health degree information is used for representing the response level of the target service system in a corresponding time dimension, and the comprehensive health degree information is used for representing the comprehensive response level of the target service system; the influence degree of the independent health degree information under different time dimensions on the determination of the comprehensive health degree information is different;
A third module, configured to determine a real-time flow control policy of the target service system according to the integrated health information;
and a fourth module, configured to perform flow control on the target access request according to the real-time flow control policy.
13. An electronic device comprising a processor and a memory;
the memory is used for storing programs;
the processor executing the program to implement the method of any one of claims 1 to 11.
14. A computer-readable storage medium, characterized in that the storage medium stores a program that is executed by a processor to implement the method of any one of claims 1 to 11.
15. A computer program product comprising a computer program which, when executed by a processor, implements the method of any one of claims 1 to 11.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210678901.0A CN117294652A (en) | 2022-06-16 | 2022-06-16 | Flow control method, server, electronic device, and computer-readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210678901.0A CN117294652A (en) | 2022-06-16 | 2022-06-16 | Flow control method, server, electronic device, and computer-readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117294652A true CN117294652A (en) | 2023-12-26 |
Family
ID=89252247
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210678901.0A Pending CN117294652A (en) | 2022-06-16 | 2022-06-16 | Flow control method, server, electronic device, and computer-readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117294652A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117556452A (en) * | 2024-01-10 | 2024-02-13 | 支付宝(杭州)信息技术有限公司 | Access control method for database and related equipment |
-
2022
- 2022-06-16 CN CN202210678901.0A patent/CN117294652A/en active Pending
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117556452A (en) * | 2024-01-10 | 2024-02-13 | 支付宝(杭州)信息技术有限公司 | Access control method for database and related equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9571347B2 (en) | Reactive auto-scaling of capacity | |
| CN108090225B (en) | Database instance running method, device and system and computer readable storage medium | |
| CN1658557B (en) | Architecture for controlling access to a service by concurrent clients | |
| US20140301218A1 (en) | Statistical analysis and prompting method and system for mobile terminal internet traffic | |
| CN107644340A (en) | Risk Identification Method, client device and risk recognition system | |
| CN109766362B (en) | Data processing method and device | |
| US8331250B2 (en) | System and method for strategic network planning | |
| CN103368867A (en) | Method and system of cached object communicating with secondary site through network | |
| CN105139253B (en) | Cloud optimization method for self-service tax handling | |
| US7499968B1 (en) | System and method for application resource utilization metering and cost allocation in a utility computing environment | |
| CN111582955A (en) | Promotion information display method and device, electronic equipment and storage medium | |
| CN117294652A (en) | Flow control method, server, electronic device, and computer-readable storage medium | |
| US20180007128A1 (en) | Modeling and Forecasting Reserve Capacity for Overbooked Clusters | |
| WO2013167908A1 (en) | Method of operating a server apparatus for delivering website content, server apparatus and device in communication with server apparatus | |
| CN109150593B (en) | Method and device for managing resources in cloud data system | |
| CN108416662A (en) | A kind of data verification method and device | |
| CN113343577B (en) | Parameter optimization method, device, equipment and medium based on machine learning | |
| CN108989088A (en) | A kind of log method for uploading and communication equipment | |
| EP3908015A1 (en) | Method of determining shared service index for shared service communication certificate | |
| CN111198986B (en) | Information transmission method, device, electronic equipment and storage medium | |
| CN112783637B (en) | Resource regulation and control method and device | |
| CN109670980B (en) | Method, system and equipment for processing charging service data | |
| CN116450353A (en) | Processor core matching method and device, electronic equipment and storage medium | |
| CN111160991A (en) | PDB advertisement traffic optimization method, device, storage medium and electronic equipment | |
| CN107798056A (en) | A kind of data query method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |