CN114785734B - Flow processing method, flow processing device, flow processing equipment, computer readable storage medium and flow processing product - Google Patents
Flow processing method, flow processing device, flow processing equipment, computer readable storage medium and flow processing product Download PDFInfo
- Publication number
- CN114785734B CN114785734B CN202210408511.1A CN202210408511A CN114785734B CN 114785734 B CN114785734 B CN 114785734B CN 202210408511 A CN202210408511 A CN 202210408511A CN 114785734 B CN114785734 B CN 114785734B
- Authority
- CN
- China
- Prior art keywords
- level
- sub
- flow
- access service
- traffic
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 67
- 238000005111 flow chemistry technique Methods 0.000 title claims abstract description 58
- 238000001514 detection method Methods 0.000 claims abstract description 72
- 238000012544 monitoring process Methods 0.000 claims abstract description 29
- 238000012545 processing Methods 0.000 claims description 28
- 230000008569 process Effects 0.000 claims description 22
- 230000002265 prevention Effects 0.000 claims description 17
- 238000004891 communication Methods 0.000 claims description 11
- 238000004590 computer program Methods 0.000 claims description 11
- 238000003672 processing method Methods 0.000 claims description 4
- 239000000758 substrate Substances 0.000 claims 3
- 238000010586 diagram Methods 0.000 description 8
- 238000013461 design Methods 0.000 description 2
- 230000003828 downregulation Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 230000033228 biological regulation Effects 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000003827 upregulation Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
- H04L47/29—Flow control; Congestion control using a combination of thresholds
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
Abstract
The present disclosure provides a flow processing method, apparatus, device, computer readable storage medium, and product, applicable to big data fields or other fields. The distributed transaction platform comprises an access service level, a business plate sub-level, an application cluster sub-level and a transaction scene sub-level, wherein the access server level and each sub-level respectively correspond to preset flow control parameters; the method comprises the following steps: aiming at each sub-level, detecting whether the sub-level or the sub-level and the upper sub-level or the access service level meet the preset flow control conditions according to the monitoring parameters to obtain a detection result; and dynamically adjusting the flow configuration value of the sub-level by adopting an adjustment parameter corresponding to the sub-level according to the detection result. Therefore, the flow configuration values of each level can be accurately adjusted without configuring an independent server, so that the cost can be saved.
Description
Technical Field
The present disclosure relates to the field of big data, and in particular, to a flow processing method, apparatus, device, computer readable storage medium, and product.
Background
In the distributed technology system, the distributed transaction platform is specifically used for solving the problem of cross-application and cross-service data consistency in the distributed system, and the transaction control of the full-service plate access application needs to be comprehensively processed. In order to ensure that the distributed system can operate normally, how to ensure the high availability of the distributed transaction platform becomes a technical problem to be solved urgently.
The existing distributed transaction platform processing method is to split tenants, process high-frequency transactions through independent servers and limit flow. However, the transaction flow cannot be predicted in advance by adopting the method, so that the accurate splitting of the high-frequency transaction cannot be realized, and the service pressure of the distributed transaction platform cannot be effectively reduced. Furthermore, processing high frequency transactions through separate servers tends to be costly.
Disclosure of Invention
The disclosure provides a flow processing method, a flow processing device, flow processing equipment, flow processing computer readable storage media and flow processing products, which are used for solving the technical problems that the service pressure of a distributed transaction platform cannot be effectively reduced and the cost is high when the existing distributed transaction platform is used for flow processing.
The first aspect of the disclosure provides a traffic processing method, which is applied to a distributed transaction platform, wherein the distributed transaction platform comprises an access service level and at least one sub-level in communication connection with the access service level, the sub-level comprises a business plate sub-level, an application cluster sub-level and a transaction scene sub-level, the access server level and each sub-level are respectively corresponding to preset traffic prevention and control parameters, and the traffic prevention and control parameters comprise monitoring parameters and adjustment parameters; the method comprises the following steps:
For each sub-level, detecting the sub-level according to the monitoring parameters, or whether the sub-level and an upper sub-level or an access service level meet preset flow prevention and control conditions, so as to obtain a detection result;
and dynamically adjusting the flow configuration threshold of the sub-level by adopting an adjustment parameter corresponding to the sub-level according to the detection result.
A second aspect of the present disclosure provides a traffic processing apparatus, applied to a distributed transaction platform, where the distributed transaction platform includes an access service level and at least one sub-level communicatively connected to the access service level, where the sub-level includes a service plate sub-level, an application cluster sub-level, and a transaction scenario sub-level, and the access server level and each sub-level respectively correspond to preset traffic prevention and control parameters, where the traffic prevention and control parameters include a monitoring parameter and an adjustment parameter; the device comprises:
the detection module is used for respectively detecting the sub-levels according to the monitoring parameters for each sub-level, or whether the sub-level and an upper sub-level or an access service level meet preset flow control conditions or not, so as to obtain detection results;
And the processing module is used for dynamically adjusting the flow configuration threshold value of the sub-level by adopting the adjustment parameters corresponding to the sub-level according to the detection result.
A third aspect of the present disclosure is to provide an electronic device, including: a memory, a processor;
a memory; a memory for storing the processor-executable instructions;
wherein the processor is configured to invoke the program instructions in the memory to perform the flow processing method according to the first aspect.
A fourth aspect of the present disclosure provides a computer-readable storage medium having stored therein computer-executable instructions which, when executed by a processor, are adapted to carry out the flow processing method according to the first aspect.
A fifth aspect of the present disclosure provides a computer program product comprising a computer program which, when executed by a processor, implements the flow processing method according to the first aspect.
The flow processing method, the flow processing device, the flow processing equipment, the flow processing computer readable storage medium and the flow processing product are characterized in that a distributed transaction platform is divided into four levels, namely an access service level, a business plate sub-level, an application cluster sub-level and a transaction scene sub-level, and flow prevention and control parameters are set for each level. Therefore, each sub-level can respectively detect the sub-level according to the monitoring parameters, or whether the sub-level and the upper sub-level or the access service level meet the preset flow prevention and control conditions, and the sub-level can determine that the flow configuration threshold needs to be increased or the flow configuration threshold needs to be reduced according to the detection results. And further, the flow configuration value of the sub-level can be dynamically adjusted by adopting an adjustment parameter corresponding to the sub-level according to the detection result. The flow configuration values of each level can be automatically and accurately adjusted, and in addition, a separate server is not required to be configured, so that the cost can be saved.
Drawings
In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present disclosure, and other drawings may be obtained according to these drawings for a person having ordinary skill in the art.
FIG. 1 is a schematic diagram of a system architecture upon which the present disclosure is based;
fig. 2 is a flow chart of a flow processing method according to a first embodiment of the disclosure;
FIG. 3 is a schematic diagram of a distributed transaction platform according to an embodiment of the present disclosure;
fig. 4 is a flow chart of a flow processing method according to a second embodiment of the disclosure;
fig. 5 is a flow chart of a flow processing method according to a third embodiment of the disclosure;
fig. 6 is a schematic structural diagram of a flow processing apparatus according to a fourth embodiment of the present disclosure;
fig. 7 is a schematic structural diagram of an electronic device according to a fifth embodiment of the present disclosure.
Detailed Description
For the purposes of making the objects, technical solutions and advantages of the embodiments of the present disclosure more apparent, the technical solutions of the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present disclosure, and it is apparent that the described embodiments are some embodiments of the present disclosure, but not all embodiments. All other embodiments obtained based on the embodiments in the present disclosure are within the scope of the protection of the present disclosure.
Aiming at the technical problems that the service pressure of the distributed transaction platform cannot be effectively reduced and the cost is high when the existing distributed transaction platform performs flow processing, the disclosure provides a flow processing method, a flow processing device, flow processing equipment, a flow processing computer readable storage medium and a flow processing product.
The flow processing method, the flow processing device, the flow processing equipment, the flow processing computer readable storage medium and the flow processing product provided by the disclosure can be applied to various scenes of business request flow regulation of the distributed transaction platform.
It should be noted that the flow processing method, apparatus, device, computer readable storage medium and product provided in the present disclosure may be used in big data field. And can be used in any field except the big data field. The flow processing method, apparatus, device, computer readable storage medium and product application field provided by the present disclosure are not limited.
The existing design mode of high-availability guarantee is to increase the number of service nodes of a transaction platform through transverse capacity expansion, so that the external service capability is enhanced. The method has higher feasibility under the common service scene, so that the upper limit of the processing service capacity is improved, but when a certain service scene bursts out of flow flood peaks, the business platform can be impacted instantaneously, the connection is not available, and other business transactions cannot be processed. Another possible design approach is to split tenants, process high frequency transactions through separate servers, and impose flow restrictions. Although the mode effectively prevents and controls the high-frequency transaction flow flood peak, the processing cost is too high, the transaction flow cannot be predicted in advance, all high-frequency transactions are split into independent tenants, the daily transaction flow is low, and it is quite uneconomical to configure the server according to the highest specification.
In the process of solving the technical problems, the inventor finds that the distributed service platform can be divided into four levels of access service, service plate, application cluster and transaction scene through research, and the flow prevention and control parameters and the flow configuration threshold are respectively set for each level. Therefore, when the distributed service platform operates, the current service pressure of each level can be automatically detected according to the flow control parameters, and then the flow configuration threshold value of each level can be adjusted according to the detection result.
Fig. 1 is a schematic diagram of a system architecture based on the present disclosure, as shown in fig. 1, where the system architecture based on the present disclosure at least includes: a distributed transaction platform 11 and a terminal device 12. Wherein the distributed transaction platform 11 is communicatively connected to the terminal device 12. The distributed transaction platform 11 is provided with a flow processing device which can be written by adopting languages such as C/C++, java, shell or Python; the terminal device 1 may be, for example, a desktop computer, a tablet computer, etc.
When the flow processing device cannot adjust the flow configuration value of the distributed transaction platform 11, early warning reminding information can be sent to the terminal equipment. Therefore, the user can manually adjust the flow configuration value of the distributed transaction platform 11 after receiving the early warning reminding information.
Fig. 2 is a flow chart of a flow processing method provided in an embodiment of the present disclosure, where the flow processing method is applied to a distributed transaction platform, the distributed transaction platform includes an access service level and at least one sub-level communicatively connected to the access service level, where the sub-level includes a service block sub-level, an application cluster sub-level, and a transaction scenario sub-level, the access server level and each sub-level respectively correspond to preset flow control parameters, and the flow control parameters include a monitoring parameter and an adjustment parameter.
The method comprises the following steps as shown in fig. 2:
step 201, for each sub-level, detecting the sub-level according to the monitoring parameter, or whether the sub-level and the upper sub-level or the access service level meet a preset flow control condition, to obtain a detection result.
The execution body of the present embodiment is a flow processing device, which may be coupled to a distributed transaction platform. In order to ensure high availability of the distributed transaction platform, the distributed transaction platform can be divided into an access service level, a service plate sub-level, an application cluster sub-level and a transaction scene sub-level, and dynamic adjustment can be carried out level by level according to actual flow of each level, so that dynamic balance is achieved under the condition that the resource is maximally utilized.
In this embodiment, in order to make the maximum utilization of the distributed transaction platform resource, when the current actual traffic of any hierarchy is larger, a threshold may be configured for the traffic of the hierarchy, so that the hierarchy can process more service requests. Optionally, when the current actual traffic of any hierarchy is smaller, the traffic configuration threshold of the hierarchy may be reduced, so that the hierarchy with the larger traffic pressure can perform capacity expansion operation according to the traffic configuration released by the sub-hierarchy, so as to implement processing of more traffic requests.
Therefore, in order to accurately adjust the flow configuration threshold of each sub-level, first, for each sub-level, the sub-level can judge whether itself meets the preset flow control condition according to the preset monitoring parameter, so as to obtain the detection result. Therefore, whether the current service pressure of the sub-level is larger can be judged according to the detection result, and whether the sub-level needs to perform the flow configuration threshold up-regulation operation can be further determined.
Or, for each sub-level, the sub-level can determine whether the sub-level and the sub-level of the upper layer or the access service level meet the preset flow control conditions according to the preset monitoring parameters, and a detection result is obtained, so that whether the current service pressure of the sub-level is smaller can be determined according to the detection result, and further whether the sub-level needs to perform the flow configuration threshold value down-regulation operation can be determined.
And 202, dynamically adjusting the flow configuration threshold of the sub-level by adopting an adjustment parameter corresponding to the sub-level according to the detection result.
In this embodiment, after a detection result is obtained according to whether the sub-level, or whether the sub-level and the upper sub-level or the access service level meet the preset traffic control conditions, the traffic configuration threshold of the sub-level may be dynamically adjusted according to the adjustment parameter corresponding to the sub-level of the detection result.
Optionally, if the current service pressure of the sub-level is detected to be greater, an up-adjustment operation may be performed on the traffic configuration threshold corresponding to the sub-level, so that the sub-level can process more service requests.
Optionally, if the current service pressure of the sub-level is detected to be smaller, the flow configuration threshold corresponding to the sub-level may be subjected to a down-adjustment operation, so that other levels with larger service pressures may perform a capacity expansion operation according to the flow configuration released by the sub-level, so as to implement processing of more service requests.
The flow configuration threshold is dynamically adjusted according to the actual service request flow, so that the distributed transaction platform is guaranteed to be high in availability under the condition of low cost, and the distributed transaction platform resource is enabled to be maximally utilized.
Fig. 3 is a schematic structural diagram of a distributed transaction platform according to an embodiment of the present disclosure, and as shown in fig. 3, the distributed transaction platform 31 specifically includes an access service level 32, a service plate sub-level 33, an application cluster sub-level 34, and a transaction scenario sub-level 35. The number of the service board sub-level 33, the application cluster sub-level 34, and the transaction scenario sub-level 35 may be plural, and the access service level 32 may issue the service request to the service board sub-level 33 communicatively connected thereto after acquiring the service request. Each sub-level may issue the acquired service request layer by layer.
Further, on the basis of the first embodiment, the method further includes:
and monitoring whether the real-time flow of the service request received by the access service level is larger than a flow configuration threshold corresponding to the access service level in real time.
And if the service request is larger than the preset time range, controlling the access service level to stop receiving the service request within the preset time range.
In this embodiment, the access service level may be specifically the first level in the distributed transaction platform, which can obtain all service requests that need to be processed by the distributed transaction platform. Therefore, the access service level cannot perform the capacity expansion operation.
To ensure that the distributed transaction platform is highly available, real-time traffic for service requests received at the access service level may be determined in real-time. And determining whether the real-time traffic corresponding to the access service level is greater than a traffic configuration threshold corresponding to the access service level. If the service pressure is not greater than the service pressure, the current service pressure of the access service level is not great, and the normal operation of the distributed transaction platform can be ensured. Otherwise, the current service pressure of the access service level is higher, and at this time, the access service level can be controlled to stop receiving the service request within a preset time range. The preset time range may be specifically set by the user according to the actual requirement. The present disclosure is not limited in this regard as to the time required to detect that the access service level has processed the current service request.
Further, on the basis of the first embodiment, the access server level and each sub-level respectively correspond to a preset flow configuration threshold; further comprises:
and when the distributed transaction platform runs for the first time, detecting whether the real-time flow of the service request currently received by the access server level and each sub-level is larger than the flow configuration threshold corresponding to the access server level and each sub-level or not in real time.
And if the service request is larger than the preset time range, controlling the access server level and each sub-level to stop receiving the service request.
In this embodiment, the corresponding flow configuration thresholds may be set for four levels in advance, and the flow configuration thresholds corresponding to the four levels are decreased from level to level according to the processing capability of each level. When the distributed transaction platform runs for the first time, whether the real-time traffic of the service request currently received by the access server level and each sub-level is larger than the traffic configuration threshold corresponding to the access server level and each sub-level can be detected in real time. If the service request is larger than the preset time range, controlling the access server level and each sub-level to stop receiving the service request.
Specifically, when the access server level request flow reaches a configuration maximum value, the distributed transaction platform refuses other service requests within a preset time range; when the request flow of a certain service plate sub-level reaches the configuration maximum value, rejecting the rest service requests of the plate within a preset time range by the service plate sub-level; when the request flow of a certain application cluster sub-level reaches a configuration maximum value, rejecting other service requests of the application within a preset time range by the application cluster sub-level; when the request flow of a certain transaction scene sub-level reaches the configuration maximum value, the transaction scene sub-level refuses the rest service requests of the scene within a preset time range.
According to the traffic processing method provided by the embodiment, the distributed transaction platform is divided into four levels, namely an access service level, a business plate sub-level, an application cluster sub-level and a transaction scene sub-level, and traffic prevention and control parameters are set for each level. Therefore, each sub-level can respectively detect the sub-level according to the monitoring parameters, or whether the sub-level and the upper sub-level or the access service level meet the preset flow prevention and control conditions, and the sub-level can determine that the flow configuration threshold needs to be increased or the flow configuration threshold needs to be reduced according to the detection results. And further, the flow configuration value of the sub-level can be dynamically adjusted by adopting an adjustment parameter corresponding to the sub-level according to the detection result. The flow configuration values of each level can be automatically and accurately adjusted, and in addition, a separate server is not required to be configured, so that the cost can be saved.
Fig. 4 is a flow chart of a flow processing method provided in a second embodiment of the present disclosure, where, based on the first embodiment, the access server level and each sub-level respectively correspond to a preset flow configuration threshold; the monitoring parameters comprise detection frequency and trigger control rate threshold; as shown in fig. 4, step 201 includes:
Step 401, for each sub-level, determining, according to the detection frequency, a real-time flow of a service request currently received by the sub-level and a current trigger control rate of the sub-level.
Step 402, detecting whether the real-time traffic exceeds the traffic configuration threshold corresponding to the sub-level, and determining whether the trigger control rate of the sub-level in the two detection processes exceeds the trigger control rate threshold.
Step 403, if it is detected that the real-time traffic corresponding to the sub-level exceeds the traffic configuration threshold corresponding to the sub-level, and the trigger control rate of the sub-level in the two detection processes exceeds the trigger control rate threshold corresponding to the sub-level, it is determined that the traffic configuration threshold corresponding to the sub-level cannot meet the current service requirement.
In this embodiment, the monitoring parameters may specifically include a detection frequency and a trigger control rate threshold. For each sub-level, the sub-level may determine the real-time traffic of the service request currently received by the sub-level and the current trigger control rate of the sub-level using its corresponding detection frequency. And detecting whether the real-time traffic exceeds a traffic configuration threshold corresponding to the sub-level. If the current service pressure exceeds the current service pressure of the sub-level, the current service pressure of the sub-level is represented to be larger. In addition, whether the trigger control rate of the sub-level in the two detection processes exceeds a preset trigger control rate threshold is determined.
If the real-time flow corresponding to the sub-level is detected to exceed the flow configuration threshold corresponding to the sub-level, and the trigger control rate of the sub-level in the two detection processes exceeds the trigger control rate threshold corresponding to the sub-level, the flow configuration threshold corresponding to the sub-level is determined to be incapable of meeting the current service requirement. That is, the current service pressure of the sub-level is high, and the flow configuration threshold needs to be adjusted upwards.
Further, on the basis of any one of the above embodiments, the adjustment parameters include an adjustment amplitude threshold and an adjustment ratio; step 202 comprises:
if the traffic configuration threshold corresponding to the sub-level is detected to be unable to meet the current service requirement, detecting whether the real-time traffic of the service request currently received by the sub-level is larger than the traffic configuration threshold corresponding to the upper sub-level or the access service level which is in communication connection with the sub-level.
If the flow configuration value is larger than the preset flow configuration value, early warning reminding information is sent to the terminal equipment, and the early warning reminding information is used for reminding a user to manually adjust the flow configuration value of the sub-level.
If not, determining whether the current adjustment amplitude of the sub-level is larger than a preset adjustment amplitude threshold.
And if the current adjustment amplitude of the sub-level is not greater than the adjustment amplitude threshold, adjusting the flow configuration threshold corresponding to the sub-level according to the adjustment proportion.
And if the current adjustment amplitude of the sub-level is larger than the adjustment amplitude threshold, sending early warning reminding information to the terminal equipment, wherein the early warning reminding information is used for reminding a user to manually adjust the flow configuration value of the sub-level.
In this embodiment, if it is detected that the traffic configuration threshold corresponding to any sub-level cannot meet the current service requirement, it may be first detected whether the real-time traffic of the service request currently received by the sub-level is greater than the traffic configuration threshold corresponding to the upper sub-level or the access service level in communication connection with the sub-level. Because the service requests received by each sub-level are issued by the upper sub-level or the access service level, if the real-time flow of the service requests currently received by the sub-level is greater than the flow configuration threshold corresponding to the upper sub-level or the access service level in communication connection with the sub-level, the distributed service platform is represented to be faulty currently, therefore, early warning reminding information can be sent to the terminal equipment, and the early warning reminding information is used for reminding a user to manually adjust the flow configuration value of the sub-level.
Otherwise, the distributed service platform is characterized to run normally at present, and whether the current required adjustment amplitude of the sub-level is larger than a preset adjustment amplitude threshold value can be further detected. If the flow configuration threshold is larger than the preset adjustment amplitude threshold, the flow processing device cannot automatically adjust the flow configuration threshold of the sub-level, and early warning reminding information is needed to be sent to the terminal equipment at the moment and used for reminding a user to manually adjust the flow configuration value of the sub-level. And if the flow configuration threshold value is not greater than the flow configuration threshold value, adjusting the flow configuration threshold value corresponding to the sub-level according to the adjustment proportion.
According to the flow processing method, when the flow configuration threshold corresponding to any sub-level cannot meet the current service requirement, the flow configuration threshold corresponding to the sub-level is adjusted upwards, so that the distributed transaction platform can be guaranteed not to be unavailable due to flow flood peak impact, and the distributed transaction platform is enabled to be high in availability.
Fig. 5 is a flow chart of a flow processing method according to a third embodiment of the present disclosure, where on the basis of any one of the foregoing embodiments, the access server level and each sub-level respectively correspond to a preset flow configuration threshold; the monitoring parameters comprise detection frequency and trigger control rate threshold; as shown in fig. 5, step 201 includes:
Step 501, for each sub-level, determining, according to the detection frequency, the real-time traffic of the service request currently received by the upper sub-level or the access service level and the current trigger control rate of the sub-level.
Step 502, if it is detected that the real-time traffic corresponding to the upper sub-level or the access service level exceeds the traffic configuration threshold corresponding to the upper sub-level or the access service level, and the trigger control rate of the upper sub-level or the access service level in the two detection processes exceeds the trigger control rate threshold corresponding to the upper sub-level or the access service level, acquiring the current trigger control rate and the real-time traffic of the sub-level.
Step 503, if it is detected that the current real-time traffic of the sub-level exceeds the traffic configuration threshold corresponding to the sub-level and the trigger control rate is lower than a preset trigger control rate threshold, determining that the current traffic configuration threshold of the sub-level exceeds the current service requirement.
In this embodiment, for each sub-level, the real-time traffic of the service request currently received by the upper sub-level or the access service level and the current trigger control rate of the sub-level may be determined according to the detection frequency. If the real-time traffic corresponding to the upper sub-level or the access service level is detected to exceed the traffic configuration threshold corresponding to the upper sub-level or the access service level, and the trigger control rate of the upper sub-level or the access service level in the two detection processes exceeds the trigger control rate threshold corresponding to the upper sub-level or the access service level, the current service pressure of the upper sub-level or the access service level of the sub-level is characterized to be larger, so that the current service pressure condition of the sub-level can be further detected, and further, the service request processing capacity can be dynamically allocated according to the current service pressure condition of the sub-level, so that the maximum utilization rate of the distributed transaction platform resources is ensured.
Further, the current trigger control rate of the sub-level and the real-time traffic can be obtained. If the current real-time flow of the sub-level is detected to exceed the corresponding flow configuration threshold of the sub-level and the trigger control rate is lower than the preset trigger control rate threshold, judging that the current flow configuration threshold of the sub-level exceeds the current service requirement. At this time, the processing capability of the current sub-level may be selectively released, so as to ensure that other sub-levels can cope with higher service pressures.
Further, on the basis of any one of the above embodiments, the adjustment parameters include an adjustment amplitude threshold and an adjustment ratio; step 202 comprises:
and if the flow configuration threshold corresponding to the sub-level is detected to exceed the current service requirement, performing adjustment operation according to the flow configuration threshold corresponding to the adjustment proportion corresponding to the sub-level.
In this embodiment, if it is detected that the traffic configuration threshold corresponding to any sub-level exceeds the current service requirement, the traffic configuration threshold corresponding to the sub-level is subjected to a down-adjustment operation, and specifically, the adjustment operation may be performed according to the traffic configuration threshold corresponding to the adjustment proportion corresponding to the sub-level.
According to the flow processing method provided by the embodiment, if the flow configuration threshold corresponding to any sub-level is detected to exceed the current service requirement, the flow configuration threshold corresponding to the sub-level is subjected to the down-regulation operation, so that the distributed transaction platform is ensured to be high in availability under the condition of low cost, and the distributed transaction platform resource is enabled to be maximally utilized.
Fig. 6 is a schematic structural diagram of a flow processing apparatus provided in a fourth embodiment of the present disclosure, which is applied to a distributed transaction platform, where the distributed transaction platform includes an access service level and at least one sub-level communicatively connected to the access service level, the sub-level includes a service plate sub-level, an application cluster sub-level, and a transaction scene sub-level, the access server level and each sub-level respectively correspond to preset flow prevention and control parameters, and the flow prevention and control parameters include a monitoring parameter and an adjustment parameter. As shown in fig. 6, the apparatus includes: the detection module 61 and the processing module 62, wherein the detection module 61 is configured to detect, for each sub-level, according to the monitoring parameter, whether the sub-level, the upper sub-level or the access service level meets a preset flow control condition, so as to obtain a detection result. And the processing module 62 is configured to dynamically adjust the flow configuration threshold of the sub-level by adopting an adjustment parameter corresponding to the sub-level according to the detection result.
Further, on the basis of the fourth embodiment, the apparatus further includes: the first detection module and the first control module. And the first detection module is used for monitoring whether the real-time flow of the service request received by the access service level is larger than the flow configuration threshold corresponding to the access service level in real time. And the first control module is used for controlling the access service level to stop receiving the service request within a preset time range if the access service level is larger than the preset time range.
Further, on the basis of the fourth embodiment, the access server level and each sub-level respectively correspond to a preset traffic configuration threshold. Further comprises: the second detection module and the second control module. And the second detection module is used for detecting whether the real-time flow of the service request currently received by the access server level and each sub-level is larger than the flow configuration threshold value corresponding to the access server level and each sub-level in real time when the distributed transaction platform runs for the first time. And the second control module is used for controlling the access server level and each sub-level to stop receiving the service request within a preset time range if the access server level and each sub-level are larger than the preset time range.
Further, on the basis of any one of the above embodiments, the access server level and each sub-level respectively correspond to a preset traffic configuration threshold. The monitoring parameters comprise detection frequency and trigger control rate threshold. The detection module comprises: the first determining unit, the detecting unit and the first judging unit. The first determining unit is configured to determine, for each sub-level, a real-time traffic of a service request currently received by the sub-level and a current trigger control rate of the sub-level according to the detection frequency. The detection unit is used for detecting whether the real-time flow exceeds the flow configuration threshold corresponding to the sub-level and determining whether the trigger control rate of the sub-level in the two detection processes exceeds the trigger control rate threshold. And the first judging unit is used for judging that the flow configuration threshold corresponding to the sub-level cannot meet the current service requirement if the real-time flow corresponding to the sub-level is detected to exceed the flow configuration threshold corresponding to the sub-level and the trigger control rate of the sub-level in the two detection processes exceeds the trigger control rate threshold corresponding to the sub-level.
Further, on the basis of any one of the above embodiments, the adjustment parameters include an adjustment amplitude threshold and an adjustment ratio. The processing module comprises: the device comprises a first detection unit, a first processing unit, a third processing unit and a fourth processing unit. The first detection unit is configured to detect whether a real-time traffic of a service request currently received by the sub-level is greater than a traffic configuration threshold corresponding to an upper sub-level or an access service level in communication connection with the sub-level if it is detected that the traffic configuration threshold corresponding to the sub-level cannot meet a current service requirement. And the first processing unit is used for sending early warning reminding information to the terminal equipment if the flow configuration value of the sub-level is larger than the preset flow configuration value, wherein the early warning reminding information is used for reminding a user to manually adjust the flow configuration value of the sub-level. And the second processing unit is used for determining whether the current adjustment amplitude of the sub-level is larger than a preset adjustment amplitude threshold value or not if the current adjustment amplitude of the sub-level is not larger than the preset adjustment amplitude threshold value. And the third processing unit is used for adjusting the flow configuration threshold corresponding to the sub-level according to the adjustment proportion if the current adjustment amplitude of the sub-level is not greater than the adjustment amplitude threshold. And the fourth processing unit is used for sending early warning reminding information to the terminal equipment if the current adjustment amplitude of the sub-level is larger than the adjustment amplitude threshold, wherein the early warning reminding information is used for reminding a user to manually adjust the flow configuration value of the sub-level.
Further, on the basis of any one of the above embodiments, the access server level and each sub-level respectively correspond to a preset traffic configuration threshold. The monitoring parameters comprise detection frequency and trigger control rate threshold. The detection module comprises: the second determination unit, the acquisition unit, and the second determination unit. The second determining unit is configured to determine, for each sub-level, a real-time traffic of a service request currently received by the upper sub-level or the access service level and a current trigger control rate of the sub-level according to the detection frequency. The acquisition unit is configured to acquire a current trigger control rate and real-time traffic of the sub-hierarchy if it is detected that the real-time traffic corresponding to the upper sub-hierarchy or the access service hierarchy exceeds a traffic configuration threshold corresponding to the upper sub-hierarchy or the access service hierarchy, and the trigger control rate of the upper sub-hierarchy or the access service hierarchy in the two detection processes exceeds the trigger control rate threshold corresponding to the upper sub-hierarchy or the access service hierarchy. And the second judging unit is used for judging that the current flow configuration threshold value of the sub-level exceeds the current service requirement if the current real-time flow of the sub-level exceeds the corresponding flow configuration threshold value of the sub-level and the trigger control rate is lower than the preset trigger control rate threshold value.
Further, on the basis of any one of the above embodiments, the adjustment parameters include an adjustment amplitude threshold and an adjustment ratio. The processing module is used for comprising: and the fifth processing unit is used for performing adjustment operation according to the flow configuration threshold corresponding to the adjustment proportion corresponding to the sub-level if the flow configuration threshold corresponding to the sub-level is detected to exceed the current service requirement.
Fig. 7 is a schematic structural diagram of an electronic device according to a fifth embodiment of the present disclosure, and as shown in fig. 7, the electronic device 700 may be a terminal device or a server. The terminal device may include, but is not limited to, a mobile terminal such as a mobile phone, a notebook computer, a digital broadcast receiver, a personal digital assistant (Personal Digital Assistant, PDA for short), a tablet (Portable Android Device, PAD for short), a portable multimedia player (Portable Media Player, PMP for short), an in-vehicle terminal (e.g., an in-vehicle navigation terminal), and the like, and a fixed terminal such as a digital TV, a desktop computer, and the like. The electronic device shown in fig. 7 is merely an example and should not be construed to limit the functionality and scope of use of the disclosed embodiments.
As shown in fig. 7, the electronic apparatus 700 may include a processing device (e.g., a central processing unit, a graphics processor, etc.) 701 that may perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) 702 or a program loaded from a storage device 708 into a random access Memory (Random Access Memory, RAM) 703. In the RAM 703, various programs and data required for the operation of the electronic device 700 are also stored. The processing device 701, the ROM 702, and the RAM 703 are connected to each other through a bus 704. An input/output (I/O) interface 705 is also connected to bus 704.
In general, the following devices may be connected to the I/O interface 705: input devices 706 including, for example, a touch screen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, and the like; an output device 707 including, for example, a liquid crystal display (Liquid Crystal Display, LCD for short), a speaker, a vibrator, and the like; storage 708 including, for example, magnetic tape, hard disk, etc.; and a communication device 709. The communication means 709 may allow the electronic device 700 to communicate wirelessly or by wire with other devices to exchange data. While fig. 7 shows an electronic device 700 having various means, it is to be understood that not all of the illustrated means are required to be implemented or provided. More or fewer devices may be implemented or provided instead.
In particular, according to embodiments of the present disclosure, the processes described above with reference to flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method shown in the flowcharts. In such an embodiment, the computer program may be downloaded and installed from a network via communication device 709, or installed from storage 708, or installed from ROM 702. The above-described functions defined in the methods of the embodiments of the present disclosure are performed when the computer program is executed by the processing device 701.
Still another embodiment of the present disclosure provides an electronic device, including: a memory, a processor;
a memory; a memory for storing the processor-executable instructions;
the processor is configured to call the program instruction in the memory to execute the flow processing method according to any one of the embodiments.
Yet another embodiment of the present disclosure further provides a computer-readable storage medium having stored therein computer-executable instructions that, when executed by a processor, are configured to implement a flow processing method as in any one of the embodiments above.
Yet another embodiment of the present disclosure also provides a computer program product comprising a computer program which, when executed by a processor, implements a flow processing method as described in any of the above embodiments.
It will be clear to those skilled in the art that, for convenience and brevity of description, reference may be made to the corresponding process in the foregoing method embodiment for the specific working process of the apparatus described above, which is not described herein again.
Those of ordinary skill in the art will appreciate that: all or part of the steps for implementing the method embodiments described above may be performed by hardware associated with program instructions. The foregoing program may be stored in a computer readable storage medium. The program, when executed, performs steps including the method embodiments described above; and the aforementioned storage medium includes: various media that can store program code, such as ROM, RAM, magnetic or optical disks.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present disclosure, and not for limiting the same; although the present disclosure has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some or all of the technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present disclosure.
Claims (10)
1. The traffic processing method is characterized by being applied to a distributed transaction platform, wherein the distributed transaction platform comprises an access service level and at least one sub-level in communication connection with the access service level, the sub-level comprises a business plate sub-level, an application cluster sub-level and a transaction scene sub-level, the access service level and each sub-level are respectively corresponding to preset traffic prevention and control parameters and preset traffic configuration thresholds, and the traffic prevention and control parameters comprise monitoring parameters and adjustment parameters; the monitoring parameters comprise detection frequency and trigger control rate threshold; the adjustment parameters comprise an adjustment amplitude threshold value and an adjustment proportion; the method comprises the following steps:
for each sub-level, detecting the sub-level according to the monitoring parameters, or whether the sub-level and an upper sub-level or an access service level meet preset flow prevention and control conditions, so as to obtain a detection result;
according to the detection result, dynamically adjusting the flow configuration threshold of the sub-level by adopting an adjustment parameter corresponding to the sub-level;
for each sub-level, detecting the sub-level according to the monitoring parameter, or whether the sub-level and an upper sub-level or an access service level meet a preset flow control condition, to obtain a detection result, including:
For each sub-level, determining the real-time flow of the service request currently received by the upper sub-level or the access service level and the current trigger control rate of the sub-level according to the detection frequency;
if the real-time traffic corresponding to the upper sub-level or the access service level is detected to exceed the traffic configuration threshold corresponding to the upper sub-level or the access service level, and the trigger control rate of the upper sub-level or the access service level in the two detection processes exceeds the trigger control rate threshold corresponding to the upper sub-level or the access service level, acquiring the current trigger control rate and the real-time traffic of the sub-level;
if the current real-time flow of the sub-level is detected to exceed the flow configuration threshold corresponding to the sub-level and the trigger control rate is lower than a preset trigger control rate threshold, judging that the current flow configuration threshold of the sub-level exceeds the current service requirement.
2. The method of claim 1, wherein the step of determining the position of the substrate comprises,
for each sub-level, detecting the sub-level according to the monitoring parameter, or whether the sub-level and an upper sub-level or an access service level meet a preset flow control condition, to obtain a detection result, including:
For each sub-level, determining the real-time flow of the service request currently received by the sub-level and the current trigger control rate of the sub-level according to the detection frequency;
detecting whether the real-time flow exceeds a flow configuration threshold corresponding to the sub-level, and determining whether the trigger control rate of the sub-level in the two detection processes exceeds the trigger control rate threshold;
if the real-time flow corresponding to the sub-level is detected to exceed the flow configuration threshold corresponding to the sub-level, and the trigger control rate of the sub-level in the two detection processes exceeds the trigger control rate threshold corresponding to the sub-level, judging that the flow configuration threshold corresponding to the sub-level cannot meet the current service requirement.
3. The method of claim 2, wherein the step of determining the position of the substrate comprises,
and dynamically adjusting the flow configuration threshold of the sub-level by adopting an adjustment parameter corresponding to the sub-level according to the detection result, wherein the dynamically adjusting comprises the following steps:
if the traffic configuration threshold corresponding to the sub-level is detected to be unable to meet the current service requirement, detecting whether the real-time traffic of the service request currently received by the sub-level is larger than the traffic configuration threshold corresponding to the upper sub-level or the access service level which is in communication connection with the sub-level;
If the flow configuration value is larger than the preset flow configuration value, early warning reminding information is sent to the terminal equipment, and the early warning reminding information is used for reminding a user to manually adjust the flow configuration value of the sub-level;
if not, determining whether the current adjustment amplitude of the sub-level is larger than a preset adjustment amplitude threshold value;
if the current adjustment amplitude of the sub-level is not greater than the adjustment amplitude threshold, adjusting the flow configuration threshold corresponding to the sub-level according to the adjustment proportion;
and if the current adjustment amplitude of the sub-level is larger than the adjustment amplitude threshold, sending early warning reminding information to the terminal equipment, wherein the early warning reminding information is used for reminding a user to manually adjust the flow configuration value of the sub-level.
4. The method of claim 1, wherein the step of determining the position of the substrate comprises,
and dynamically adjusting the flow configuration threshold of the sub-level by adopting an adjustment parameter corresponding to the sub-level according to the detection result, wherein the dynamically adjusting comprises the following steps:
and if the flow configuration threshold corresponding to the sub-level is detected to exceed the current service requirement, performing adjustment operation according to the flow configuration threshold corresponding to the adjustment proportion corresponding to the sub-level.
5. The method according to any one of claims 1-4, further comprising:
monitoring whether the real-time flow of the service request received by the access service level is larger than a flow configuration threshold corresponding to the access service level in real time;
and if the service request is larger than the preset time range, controlling the access service level to stop receiving the service request within the preset time range.
6. The method according to any one of claims 1-4, wherein the access service level and each sub-level respectively correspond to a preset traffic configuration threshold; further comprises:
when the distributed transaction platform runs for the first time, detecting whether the real-time flow of the service request currently received by the access service level and each sub-level is larger than the flow configuration threshold value corresponding to the access service level and each sub-level or not in real time;
and if the service request is larger than the preset time range, controlling the access service level and each sub-level to stop receiving the service request.
7. The traffic processing device is characterized by being applied to a distributed transaction platform, wherein the distributed transaction platform comprises an access service level and at least one sub-level in communication connection with the access service level, the sub-level comprises a business plate sub-level, an application cluster sub-level and a transaction scene sub-level, the access service level and each sub-level are respectively corresponding to preset traffic prevention and control parameters and preset traffic configuration thresholds, and the traffic prevention and control parameters comprise monitoring parameters and adjustment parameters; the monitoring parameters comprise detection frequency and trigger control rate threshold; the adjustment parameters comprise an adjustment amplitude threshold value and an adjustment proportion; the device comprises:
The detection module is used for respectively detecting the sub-levels according to the monitoring parameters for each sub-level, or whether the sub-level and an upper sub-level or an access service level meet preset flow control conditions or not, so as to obtain detection results;
the processing module is used for dynamically adjusting the flow configuration threshold value of the sub-level by adopting an adjustment parameter corresponding to the sub-level according to the detection result;
the detection module is specifically configured to determine, for each sub-level, a real-time traffic of a service request currently received by the upper sub-level or the access service level and a current trigger control rate of the sub-level according to the detection frequency;
if the real-time traffic corresponding to the upper sub-level or the access service level is detected to exceed the traffic configuration threshold corresponding to the upper sub-level or the access service level, and the trigger control rate of the upper sub-level or the access service level in the two detection processes exceeds the trigger control rate threshold corresponding to the upper sub-level or the access service level, acquiring the current trigger control rate and the real-time traffic of the sub-level;
if the current real-time flow of the sub-level is detected to exceed the flow configuration threshold corresponding to the sub-level and the trigger control rate is lower than a preset trigger control rate threshold, judging that the current flow configuration threshold of the sub-level exceeds the current service requirement.
8. An electronic device, comprising: a memory, a processor;
a memory; a memory for storing the processor-executable instructions;
wherein the processor is configured to invoke program instructions in the memory to perform the flow processing method of any of claims 1-6.
9. A computer readable storage medium having stored therein computer executable instructions which when executed by a processor are adapted to implement the flow processing method of any of claims 1-6.
10. A computer program product comprising a computer program which, when executed by a processor, implements the flow processing method according to any of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210408511.1A CN114785734B (en) | 2022-04-19 | 2022-04-19 | Flow processing method, flow processing device, flow processing equipment, computer readable storage medium and flow processing product |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210408511.1A CN114785734B (en) | 2022-04-19 | 2022-04-19 | Flow processing method, flow processing device, flow processing equipment, computer readable storage medium and flow processing product |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114785734A CN114785734A (en) | 2022-07-22 |
| CN114785734B true CN114785734B (en) | 2024-03-26 |
Family
ID=82431568
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210408511.1A Active CN114785734B (en) | 2022-04-19 | 2022-04-19 | Flow processing method, flow processing device, flow processing equipment, computer readable storage medium and flow processing product |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114785734B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110971561A (en) * | 2018-09-28 | 2020-04-07 | 阿里巴巴集团控股有限公司 | Access request processing method, device and equipment |
| CN111817914A (en) * | 2020-06-30 | 2020-10-23 | 晨边高地(无锡)科技有限公司 | Medium-high frequency algorithm transaction interface intelligent system |
| CN112437018A (en) * | 2020-11-19 | 2021-03-02 | 百度在线网络技术（北京）有限公司 | Flow control method, device, equipment and storage medium for distributed cluster |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9129238B2 (en) * | 2010-05-12 | 2015-09-08 | Winshuttle, Llc | Dynamic web services work flow system and method |
| US11418583B2 (en) * | 2018-02-14 | 2022-08-16 | International Business Machines Corporation | Transaction process management by dynamic transaction aggregation |
-
2022
- 2022-04-19 CN CN202210408511.1A patent/CN114785734B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110971561A (en) * | 2018-09-28 | 2020-04-07 | 阿里巴巴集团控股有限公司 | Access request processing method, device and equipment |
| CN111817914A (en) * | 2020-06-30 | 2020-10-23 | 晨边高地(无锡)科技有限公司 | Medium-high frequency algorithm transaction interface intelligent system |
| CN112437018A (en) * | 2020-11-19 | 2021-03-02 | 百度在线网络技术（北京）有限公司 | Flow control method, device, equipment and storage medium for distributed cluster |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114785734A (en) | 2022-07-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10182018B2 (en) | Resource management based on device-specific or user-specific resource usage profiles | |
| US9639399B2 (en) | Method, apparatus and terminal for releasing memory | |
| CN105656810B (en) | Method and device for updating application program | |
| CN110069911B (en) | Access control method, device, system, electronic equipment and readable storage medium | |
| CN110795284B (en) | Data recovery method, device and equipment and readable storage medium | |
| US11750711B1 (en) | Systems and methods for adaptively rate limiting client service requests at a blockchain service provider platform | |
| EP3312721A1 (en) | Method and apparatus for invoking fingerprint recognition device, and mobile terminal | |
| CN114785734B (en) | Flow processing method, flow processing device, flow processing equipment, computer readable storage medium and flow processing product | |
| CN114327087A (en) | Input event processing method and device, electronic equipment and storage medium | |
| EP3373140B1 (en) | Method for processing ordered broadcast and electronic device | |
| US20140229940A1 (en) | Methods and apparatus for synchronizing multiple processors of a virtual machine | |
| WO2017118129A1 (en) | Spectrum resource sharing method and apparatus | |
| CN104601725B (en) | The response method and device of service request | |
| CN108197029B (en) | Method and device for acquiring process information | |
| CN112675535B (en) | Display interface adjusting method, device, network equipment and storage medium | |
| CN114546910A (en) | Access control method, device, storage medium and electronic device | |
| CN109815429B (en) | Browser page closing processing method and device | |
| CN107370785B (en) | Method and equipment for processing user service state information | |
| CN112995265A (en) | Request distribution method and device and electronic equipment | |
| CN108111561B (en) | Data downloading method and equipment thereof | |
| CN114782179A (en) | Server preheating method, system, electronic equipment and storage medium | |
| WO2019000473A1 (en) | Coefficient calculation method, component calling method, device, medium, server, and terminal | |
| CN115801104A (en) | Satellite transit prediction information acquisition method, device, medium and equipment | |
| CN110944051B (en) | Method and device for realizing load balance, electronic equipment and storage medium | |
| CN112416584B (en) | Process communication method and device, storage medium and mobile terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |