CN114785734A - Flow processing method, device, equipment, computer readable storage medium and product - Google Patents
Flow processing method, device, equipment, computer readable storage medium and product Download PDFInfo
- Publication number
- CN114785734A CN114785734A CN202210408511.1A CN202210408511A CN114785734A CN 114785734 A CN114785734 A CN 114785734A CN 202210408511 A CN202210408511 A CN 202210408511A CN 114785734 A CN114785734 A CN 114785734A
- Authority
- CN
- China
- Prior art keywords
- sub
- level
- layer
- traffic
- service
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 46
- 238000005111 flow chemistry technique Methods 0.000 title description 6
- 238000001514 detection method Methods 0.000 claims abstract description 66
- 230000002265 prevention Effects 0.000 claims abstract description 31
- 238000012544 monitoring process Methods 0.000 claims abstract description 30
- 238000003672 processing method Methods 0.000 claims abstract description 28
- 238000012545 processing Methods 0.000 claims description 38
- 230000008569 process Effects 0.000 claims description 22
- 238000004891 communication Methods 0.000 claims description 14
- 238000004590 computer program Methods 0.000 claims description 11
- 238000010586 diagram Methods 0.000 description 9
- 230000001276 controlling effect Effects 0.000 description 5
- 230000003247 decreasing effect Effects 0.000 description 3
- 230000003827 upregulation Effects 0.000 description 3
- 238000013461 design Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000033228 biological regulation Effects 0.000 description 1
- 230000003828 downregulation Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000001105 regulatory effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
- H04L47/29—Flow control; Congestion control using a combination of thresholds
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
Abstract
The present disclosure provides a traffic processing method, apparatus, device, computer-readable storage medium, and product, which may be applied to the big data field or other fields. The distributed transaction platform comprises an access service level, a service plate sub-level, an application cluster sub-level and a transaction scene sub-level, wherein the access server level and each sub-level are respectively and correspondingly provided with preset flow prevention and control parameters; the method comprises the following steps: aiming at each sub-level, respectively detecting the sub-level according to the monitoring parameters, or detecting whether the sub-level and the upper sub-level or the access service level meet the preset flow prevention and control conditions, and obtaining a detection result; and dynamically adjusting the flow configuration value of the sub-level by adopting the adjusting parameter corresponding to the sub-level according to the detection result. Therefore, the flow configuration value of each layer can be accurately adjusted, and an independent server does not need to be configured, so that the cost can be saved.
Description
Technical Field
The present disclosure relates to the field of big data, and in particular, to a method, an apparatus, a device, a computer-readable storage medium, and a product for processing traffic.
Background
In a distributed technology system, a distributed transaction platform is specifically used for solving the consistency of cross-application and cross-service data in the distributed system, and transaction control of full-service plate access application needs to be comprehensively processed. In order to ensure that the distributed system can normally operate, how to ensure that the distributed transaction platform is highly available becomes a technical problem to be solved urgently.
The existing distributed transaction platform processing method is to split tenants, process high-frequency transactions through a single server and limit flow. However, the transaction flow cannot be predicted in advance when the method is used for processing, so that accurate splitting of high-frequency transactions cannot be realized, and therefore, the service pressure of a distributed transaction platform cannot be effectively reduced. Furthermore, it tends to be costly to process high frequency transactions through a separate server.
Disclosure of Invention
The present disclosure provides a traffic processing method, device, apparatus, computer readable storage medium, and product, which are used to solve the technical problems that the service pressure of a distributed transaction platform cannot be effectively reduced and the cost is high when an existing distributed transaction platform performs traffic processing.
A first aspect of the present disclosure provides a traffic processing method, which is applied to a distributed transaction platform, where the distributed transaction platform includes an access service level and at least one sub-level in communication connection with the access service level, where the sub-level includes a service plate sub-level, an application cluster sub-level, and a transaction scene sub-level, the access server level and each sub-level respectively correspond to preset traffic prevention and control parameters, and the traffic prevention and control parameters include monitoring parameters and adjustment parameters; the method comprises the following steps:
aiming at each sub-level, respectively detecting the sub-level according to the monitoring parameters, or whether the sub-level and an upper sub-level or an access service level meet preset flow prevention and control conditions or not, and obtaining a detection result;
and dynamically adjusting the flow configuration threshold of the sub-level by adopting an adjustment parameter corresponding to the sub-level according to the detection result.
A second aspect of the present disclosure provides a traffic processing apparatus, which is applied to a distributed transaction platform, where the distributed transaction platform includes an access service layer and at least one sub-layer communicatively connected to the access service layer, where the sub-layer includes a service plate sub-layer, an application cluster sub-layer, and a transaction scene sub-layer, the access server layer and each sub-layer respectively correspond to preset traffic prevention and control parameters, and the traffic prevention and control parameters include monitoring parameters and adjustment parameters; the device comprises:
the detection module is used for respectively detecting the sub-levels according to the monitoring parameters aiming at each sub-level, or whether the sub-levels and the upper sub-levels or the access service levels meet preset flow prevention and control conditions or not, and obtaining a detection result;
and the processing module is used for dynamically adjusting the flow configuration threshold of the sub-level by adopting the adjustment parameters corresponding to the sub-level according to the detection result.
A third aspect of the present disclosure is to provide an electronic device, including: a memory, a processor;
a memory; a memory for storing the processor-executable instructions;
wherein the processor is configured to invoke program instructions in the memory to perform the traffic processing method according to the first aspect.
A fourth aspect of the present disclosure is to provide a computer-readable storage medium, in which computer-executable instructions are stored, and when executed by a processor, the computer-executable instructions are used for implementing the traffic processing method according to the first aspect.
A fifth aspect of the present disclosure is to provide a computer program product comprising a computer program which, when executed by a processor, implements the traffic processing method according to the first aspect.
The traffic processing method, the traffic processing device, the traffic processing equipment, the computer readable storage medium and the product provided by the disclosure divide a distributed transaction platform into four levels, namely an access service level, a service plate sub-level, an application cluster sub-level and a transaction scene sub-level, and set traffic prevention and control parameters for each level. Therefore, each sub-level can detect the sub-level according to the monitoring parameters, or whether the sub-level and the upper sub-level or the access service level meet the preset flow prevention and control conditions, and the sub-level can determine that the flow configuration threshold needs to be increased or decreased according to the detection result. And then, the flow configuration value of the sub-level can be dynamically adjusted by adopting the adjusting parameter corresponding to the sub-level according to the detection result. The flow configuration values of each layer can be automatically and accurately adjusted, and in addition, an independent server is not required to be configured, so the cost can be saved.
Drawings
In order to more clearly illustrate the embodiments or technical solutions of the present disclosure, the drawings used in the embodiments or technical solutions of the present disclosure will be briefly described below, it is obvious that the drawings in the following description are some embodiments of the present disclosure, and other drawings can be obtained by those skilled in the art according to these drawings.
FIG. 1 is a schematic diagram of a system architecture upon which the present disclosure is based;
fig. 2 is a schematic flow chart of a traffic processing method according to an embodiment of the present disclosure;
fig. 3 is a schematic structural diagram of a distributed transaction platform provided in an embodiment of the present disclosure;
fig. 4 is a schematic flow chart of a traffic processing method according to a second embodiment of the present disclosure;
fig. 5 is a schematic flow chart of a traffic processing method according to a third embodiment of the present disclosure;
fig. 6 is a schematic structural diagram of a flow processing apparatus according to a fourth embodiment of the present disclosure;
fig. 7 is a schematic structural diagram of an electronic device according to a fifth embodiment of the present disclosure.
Detailed Description
To make the objects, technical solutions and advantages of the embodiments of the present disclosure more apparent, the technical solutions in the embodiments of the present disclosure will be described clearly and completely with reference to the drawings in the embodiments of the present disclosure, and it is obvious that the described embodiments are some, but not all embodiments of the present disclosure. All other embodiments obtained based on the embodiments in the present disclosure belong to the protection scope of the present disclosure.
In view of the above-mentioned technical problems that the service pressure of the distributed transaction platform cannot be effectively reduced and the cost is high when the existing distributed transaction platform performs traffic processing, the present disclosure provides a traffic processing method, apparatus, device, computer-readable storage medium, and product.
The traffic processing method, device, equipment, computer readable storage medium and product provided by the present disclosure can be applied in various scenarios of distributed transaction platform service request traffic regulation.
It should be noted that the traffic processing method, apparatus, device, computer-readable storage medium, and product provided by the present disclosure may be used in the field of big data. But also in any field other than the big data field. The flow processing method, device, equipment, computer readable storage medium and product application field provided by the disclosure are not limited.
The existing high-availability guarantee design mode is to increase the number of service nodes of a transaction platform through horizontal capacity expansion so as to enhance the external service capability. The method has higher feasibility in a common service scene, so that the upper limit of the processing service capacity is improved, but when a certain service scene bursts a traffic peak, the transaction platform is impacted instantaneously, so that connection is unavailable, and other service transactions cannot be processed. Another more feasible design method is to split tenants, process high frequency transactions through a separate server, and impose traffic limitation. Although the method effectively prevents and controls the high-frequency transaction flow peak, the processing cost is too high, the transaction flow cannot be predicted in advance, all high-frequency transactions are divided into independent tenants, the daily transaction flow is low, and the configuration of the server according to the highest specification is not economical.
In the process of solving the technical problem, the inventor finds that the distributed service platform can be divided into four levels, namely an access service level, a service plate, an application cluster and a transaction scene, and a flow prevention and control parameter and a flow configuration threshold are respectively set for each level. Therefore, when the distributed service platform runs, the current service pressure of each level can be automatically detected according to the flow prevention and control parameters, and then the flow configuration threshold value of each level can be adjusted according to the detection result.
Fig. 1 is a schematic diagram of a system architecture on which the present disclosure is based, as shown in fig. 1, the system architecture on which the present disclosure is based at least includes: distributed transaction platform 11, terminal equipment 12. Wherein, the distributed transaction platform 11 is connected with the terminal device 12 in communication. A flow processing device is arranged in the distributed transaction platform 11, and the flow processing device can be written by adopting C/C + +, Java, Shell or Python languages and the like; the terminal device 1 may be a desktop computer, a tablet computer, or the like.
When the traffic processing device cannot adjust the traffic configuration value of the distributed transaction platform 11, the traffic processing device may send the warning reminding information to the terminal device. Therefore, the user can manually adjust the flow configuration value of the distributed transaction platform 11 after receiving the early warning reminding information.
Fig. 2 is a schematic flow diagram of a traffic processing method according to an embodiment of the present disclosure, where the method is applied to a distributed transaction platform, and the distributed transaction platform includes an access service layer and at least one sub-layer in communication connection with the access service layer, where the sub-layer includes a service plate sub-layer, an application cluster sub-layer, and a transaction scene sub-layer, the access server layer and each sub-layer respectively correspond to preset traffic prevention and control parameters, and the traffic prevention and control parameters include monitoring parameters and adjustment parameters.
As shown in fig. 2, the method includes:
The execution subject of this embodiment is a traffic processing device, which may be coupled to the distributed transaction platform. In order to ensure high availability of the distributed transaction platform, the distributed transaction platform can be divided into four levels, namely an access service level, a service plate sub-level, an application cluster sub-level and a transaction scene sub-level, and dynamic adjustment can be performed layer by layer according to actual flow of each level, so that dynamic balance is achieved under the condition that the resource is maximally utilized.
In this embodiment, in order to obtain the maximum utilization rate of the distributed transaction platform resources, when the current actual traffic of any one tier is large, a threshold may be configured for the traffic of the tier, so that the tier can process more service requests. Optionally, when the current actual traffic of any hierarchy is small, the traffic configuration threshold of the hierarchy may be reduced, so that other hierarchies with higher service pressure may perform capacity expansion operation according to the traffic configuration released by the sub-hierarchy, so as to implement processing of more service requests.
Therefore, in order to accurately adjust the flow configuration threshold of each sub-level, firstly, for each sub-level, the sub-level can judge whether the sub-level meets the preset flow prevention and control condition according to the preset monitoring parameters, and obtain the detection result. Therefore, whether the current service pressure of the sub-layer level is larger can be judged according to the detection result, and whether the sub-layer level needs to perform the up-regulation operation of the flow configuration threshold value can be further determined.
Or, for each sub-layer, the sub-layer may determine whether itself and a previous sub-layer or an access service layer satisfy a preset flow prevention and control condition according to a preset monitoring parameter, and obtain a detection result, so that whether the current service pressure of the sub-layer is low can be determined according to the detection result, and further, whether the sub-layer needs to perform a down-regulation operation of a flow configuration threshold can be determined.
And step 202, dynamically adjusting the flow configuration threshold of the sub-level by adopting the adjustment parameters corresponding to the sub-level according to the detection result.
In this embodiment, after a detection result is obtained according to whether a monitoring parameter is applied to a sub-hierarchy, or whether the sub-hierarchy and an upper sub-hierarchy or an access service hierarchy satisfy a preset traffic prevention and control condition, a traffic configuration threshold of the sub-hierarchy may be dynamically adjusted according to an adjustment parameter corresponding to the sub-hierarchy according to the detection result.
Optionally, if it is detected that the current service pressure of the sub-layer is higher, an up-regulation operation may be performed on the traffic configuration threshold corresponding to the sub-layer, so that the sub-layer can process more service requests.
Optionally, if it is detected that the current service pressure of the sub-layer level is low, the flow configuration threshold corresponding to the sub-layer level may be adjusted downward, so that other levels with high service pressure may perform capacity expansion operation according to the flow configuration released by the sub-layer level, so as to implement processing of more service requests.
The flow configuration threshold is dynamically adjusted according to the actual service request flow, so that the high availability of the distributed transaction platform can be ensured under the condition of low cost, and the resource of the distributed transaction platform is enabled to obtain the maximum utilization rate.
Fig. 3 is a schematic structural diagram of a distributed transaction platform provided in an embodiment of the present disclosure, and as shown in fig. 3, the distributed transaction platform 31 specifically includes an access service layer 32, a service plate sub-layer 33, an application cluster sub-layer 34, and a transaction scenario sub-layer 35. The number of the service plate sub-hierarchy 33, the application cluster sub-hierarchy 34, and the transaction scenario sub-hierarchy 35 may be multiple, and after acquiring the service request, the access service hierarchy 32 may issue the service request to the service plate sub-hierarchy 33 in communication connection therewith. Each sub-layer level can issue the acquired service request layer by layer.
Further, on the basis of the first embodiment, the method further includes:
and monitoring whether the real-time flow of the service request received by the access service level is larger than a flow configuration threshold value corresponding to the access service level or not in real time.
And if so, controlling the access service level to stop receiving the service request within a preset time range.
In this embodiment, the access service level may specifically be a first level in the distributed transaction platform, and may acquire all service requests that need to be processed by the distributed transaction platform. Therefore, the access service level cannot perform capacity expansion operation.
In order to ensure that the distributed transaction platform is highly available, the real-time traffic of the service requests received by the access service level can be determined in real time. And determining whether the real-time traffic corresponding to the access service level is greater than a traffic configuration threshold corresponding to the access service level. If the current service pressure is not greater than the preset threshold value, the current service pressure of the access service level is represented to be not large, and the normal operation of the distributed transaction platform can be guaranteed. Otherwise, the current service pressure of the access service level is represented to be larger, and at this time, the access service level can be controlled to stop receiving the service request within the preset time range. The preset time range can be specifically set for a user according to actual requirements. The time required for processing the current service request for detecting the access service level may also be considered, and the disclosure is not limited thereto.
Further, on the basis of the first embodiment, the access server hierarchy and each sub-hierarchy respectively correspond to a preset flow configuration threshold; further comprising:
when the distributed transaction platform operates for the first time, detecting whether the real-time flow of the service request currently received by the access server level and each sub-level is larger than the flow configuration threshold value corresponding to the access server level and each sub-level in real time.
And if so, controlling the access server level and each sub-level to stop receiving the service request within a preset time range.
In this embodiment, corresponding flow configuration thresholds may be set in advance for four levels, and the flow configuration thresholds corresponding to the four levels are gradually decreased level by level according to the processing capability of each level. When the distributed transaction platform operates for the first time, whether the real-time flow of the service request currently received by the access server level and each sub-level is larger than the flow configuration threshold value corresponding to the access server level and each sub-level can be detected in real time. And if so, controlling the access server level and each sub-level to stop receiving the service request within a preset time range.
Specifically, when the access server level request flow reaches the configuration maximum value, the distributed transaction platform rejects other service requests within a preset time range; when the sub-layer request flow of a certain service plate block reaches the maximum configuration value, the sub-layer of the service plate block rejects other service requests of the plate block within a preset time range; when the sub-level request flow of a certain application cluster reaches the maximum configuration value, the sub-level of the application cluster refuses other service requests of the application within a preset time range; when the request flow of a certain transaction scene sub-level reaches the maximum configuration value, the transaction scene sub-level refuses other service requests of the scene within a preset time range.
In the traffic processing method provided in this embodiment, the distributed transaction platform is divided into four levels, namely, an access service level, a service plate sub-level, an application cluster sub-level, and a transaction scene sub-level, and a traffic prevention and control parameter is set for each level. Therefore, each sub-level can detect the sub-level according to the monitoring parameters, or whether the sub-level and the upper sub-level or the access service level meet the preset flow prevention and control condition, and the sub-level can determine that the flow configuration threshold needs to be increased or decreased according to the detection result. And then, the flow configuration value of the sub-level can be dynamically adjusted by adopting the adjusting parameter corresponding to the sub-level according to the detection result. The flow configuration values of each layer can be automatically and accurately adjusted, and in addition, an independent server is not required to be configured, so the cost can be saved.
Fig. 4 is a schematic flow chart of a traffic processing method according to a second embodiment of the present disclosure, where on the basis of the first embodiment, the access server hierarchy and each sub-hierarchy respectively correspond to a preset traffic configuration threshold; the monitoring parameters comprise detection frequency and a trigger control rate threshold; as shown in fig. 4, step 201 includes:
In this embodiment, the monitoring parameters may specifically include a detection frequency and a trigger control rate threshold. For each sub-level, the sub-level may determine the real-time traffic of the service request currently received by the sub-level and the current trigger control rate of the sub-level by using the corresponding detection frequency. And detecting whether the real-time flow exceeds a flow configuration threshold value corresponding to a sub-layer level. If the current traffic pressure exceeds the preset value, the current traffic pressure of the sub-layer level is represented to be larger. In addition, whether the trigger control rate of the sub-layer level in the two detection processes exceeds a preset trigger control rate threshold value is determined.
If it is detected that the real-time flow corresponding to the sub-layer exceeds the flow configuration threshold corresponding to the sub-layer, and the trigger control rate of the sub-layer in the two detection processes exceeds the trigger control rate threshold corresponding to the sub-layer, it is determined that the flow configuration threshold corresponding to the sub-layer cannot meet the current service requirement. That is, the current traffic pressure of the sub-layer level is large, and the up-regulation operation on the traffic configuration threshold is required.
Further, on the basis of any one of the above embodiments, the adjustment parameters include an adjustment amplitude threshold and an adjustment proportion; step 202 comprises:
and if the fact that the flow configuration threshold corresponding to the sub-level cannot meet the current service requirement is detected, detecting whether the real-time flow of the service request currently received by the sub-level is larger than the flow configuration threshold corresponding to an upper sub-level or an access service level in communication connection with the sub-level.
And if so, sending early warning reminding information to the terminal equipment, wherein the early warning reminding information is used for reminding a user of manually adjusting the flow configuration value of the sub-level.
If not, determining whether the current adjustment amplitude of the sub-layer level is larger than a preset adjustment amplitude threshold value.
And if the current adjustment amplitude of the sub-layer level is not larger than the adjustment amplitude threshold, adjusting the flow configuration threshold corresponding to the sub-layer level according to the adjustment proportion.
And if the current adjustment amplitude of the sub-level is larger than the adjustment amplitude threshold, sending early warning reminding information to terminal equipment, wherein the early warning reminding information is used for reminding a user to manually adjust the flow configuration value of the sub-level.
In this embodiment, if it is detected that the traffic configuration threshold corresponding to any sub-tier cannot meet the current service requirement, it may be first detected whether the real-time traffic of the service request currently received by the sub-tier is greater than the traffic configuration threshold corresponding to the upper sub-tier or the access service tier that is in communication connection with the sub-tier. Because the service requests received by each sub-level are issued by the upper sub-level or the access service level, if the real-time flow of the service request currently received by the sub-level is greater than the flow configuration threshold corresponding to the upper sub-level or the access service level which is in communication connection with the sub-level, it is represented that the distributed service platform fails currently, and therefore early warning reminding information can be sent to the terminal equipment and used for reminding a user of manually adjusting the flow configuration value of the sub-level.
Otherwise, the distributed service platform is characterized to be currently and normally operated, and whether the currently required adjustment amplitude of the sub-layer level is larger than a preset adjustment amplitude threshold value can be further detected. If the flow configuration threshold is larger than the preset adjustment amplitude threshold, the flow processing device cannot automatically adjust the flow configuration threshold of the sublevel, and at this time, early warning reminding information needs to be sent to the terminal device, and the early warning reminding information is used for reminding a user of manually adjusting the flow configuration value of the sublevel. If not, adjusting operation can be performed on the flow configuration threshold corresponding to the sub-level according to the adjustment proportion.
According to the traffic processing method provided by the embodiment, when it is detected that the traffic configuration threshold corresponding to any sub-level cannot meet the current service requirement, the traffic configuration threshold corresponding to the sub-level is adjusted up, so that the distributed transaction platform cannot be disabled due to impact of a traffic flood peak, and the distributed transaction platform is enabled to be highly available.
Fig. 5 is a schematic flow chart of a traffic processing method according to a third embodiment of the present disclosure, where on the basis of any of the foregoing embodiments, the access server level and each sub-level respectively correspond to a preset traffic configuration threshold; the monitoring parameters comprise detection frequency and a trigger control rate threshold; as shown in fig. 5, step 201 includes:
and step 501, aiming at each sub-level, determining the real-time flow of the service request currently received by the upper sub-level or the access service level and the current trigger control rate of the sub-level according to the detection frequency.
In this embodiment, for each sub-tier, the real-time traffic of the service request currently received by the upper sub-tier or the access service tier and the current trigger control rate of the sub-tier may be determined according to the detection frequency. If the fact that the real-time flow corresponding to the upper sub-level or the access service level exceeds the flow configuration threshold corresponding to the upper sub-level or the access service level is detected, and the trigger control rate of the upper sub-level or the access service level in the two detection processes exceeds the trigger control rate threshold corresponding to the upper sub-level or the access service level, the current service pressure of the upper sub-level or the access service level of the sub-level is represented to be higher, therefore, the current service pressure condition of the sub-level can be further detected, and further, the service request processing capacity can be dynamically distributed according to the current service pressure condition of the sub-level, so that the maximum utilization rate of distributed transaction platform resources is guaranteed.
Further, the current trigger control rate at the sub-layer level and the real-time traffic can be obtained. And if the fact that the current real-time flow of the sub-layer exceeds the flow configuration threshold corresponding to the sub-layer and the trigger control rate is lower than the preset trigger control rate threshold is detected, judging that the current flow configuration threshold of the sub-layer exceeds the current service requirement. At this time, the processing capacity of the current sub-hierarchy may be optionally released to ensure that other sub-hierarchies can cope with higher traffic pressure.
Further, on the basis of any of the above embodiments, the adjustment parameters include an adjustment amplitude threshold value and an adjustment proportion; step 202 comprises:
and if the flow configuration threshold corresponding to the sub-level is detected to exceed the current service requirement, adjusting according to the flow configuration threshold corresponding to the adjustment proportion corresponding to the sub-level.
In this embodiment, if it is detected that the traffic configuration threshold corresponding to any sub-level exceeds the current service requirement, the traffic configuration threshold corresponding to the sub-level is adjusted downward, and specifically, the adjustment operation may be performed according to the traffic configuration threshold corresponding to the adjustment proportion corresponding to the sub-level.
According to the traffic processing method provided by the embodiment, if it is detected that the traffic configuration threshold corresponding to any sub-level exceeds the current service requirement, the traffic configuration threshold corresponding to the sub-level is down-regulated, so that the distributed transaction platform is guaranteed to be highly available at low cost, and the resource of the distributed transaction platform is enabled to obtain the maximum utilization rate.
Fig. 6 is a schematic structural diagram of a traffic processing apparatus according to a fourth embodiment of the present disclosure, which is applied to a distributed transaction platform, where the distributed transaction platform includes an access service layer and at least one sub-layer communicatively connected to the access service layer, where the sub-layer includes a service board sub-layer, an application cluster sub-layer, and a transaction scenario sub-layer, the access server layer and each sub-layer respectively correspond to preset traffic prevention and control parameters, and the traffic prevention and control parameters include monitoring parameters and adjustment parameters. As shown in fig. 6, the apparatus includes: a detecting module 61 and a processing module 62, where the detecting module 61 is configured to detect, for each sub-level, the sub-level according to the monitoring parameter, or whether the sub-level and an upper sub-level or an access service level meet a preset traffic prevention and control condition, so as to obtain a detection result. And a processing module 62, configured to dynamically adjust the flow configuration threshold of the sub-level by using an adjustment parameter corresponding to the sub-level according to the detection result.
Further, on the basis of the fourth embodiment, the apparatus further includes: the device comprises a first detection module and a first control module. The first detection module is used for monitoring whether the real-time flow of the service request received by the access service level is larger than the flow configuration threshold corresponding to the access service level. And the first control module is used for controlling the access service level to stop receiving the service request within a preset time range if the access service level is larger than the preset time range.
Further, on the basis of the fourth embodiment, the access server level and each sub-level respectively correspond to a preset traffic configuration threshold. Further comprising: the second detection module and the second control module. And the second detection module is used for detecting whether the real-time flow of the service requests currently received by the access server level and each sub-level is greater than the flow configuration threshold value corresponding to the access server level and each sub-level in real time when the distributed transaction platform operates for the first time. And the second control module is used for controlling the access server hierarchy and each sub-hierarchy to stop receiving the service request within a preset time range if the access server hierarchy and each sub-hierarchy are larger than the preset time range.
Further, on the basis of any of the above embodiments, the access server hierarchy and each sub-hierarchy respectively correspond to a preset traffic configuration threshold. The monitoring parameters comprise detection frequency and trigger control rate threshold. The detection module comprises: the device comprises a first determining unit, a detecting unit and a first judging unit. The first determining unit is configured to determine, for each sub-tier, a real-time traffic of a service request currently received by the sub-tier and a current trigger control rate of the sub-tier according to the detection frequency. And the detection unit is used for detecting whether the real-time flow exceeds a flow configuration threshold corresponding to the sub-level and determining whether the trigger control rate of the sub-level in the two detection processes exceeds the trigger control rate threshold. A first determining unit, configured to determine that the traffic configuration threshold corresponding to the sub-level cannot meet the current service requirement if it is detected that the real-time traffic corresponding to the sub-level exceeds the traffic configuration threshold corresponding to the sub-level, and the trigger control rate of the sub-level in the two detection processes exceeds the trigger control rate threshold corresponding to the sub-level.
Further, on the basis of any one of the above embodiments, the adjustment parameters include an adjustment amplitude threshold and an adjustment proportion. The processing module comprises: the device comprises a first detection unit, a first processing unit, a third processing unit and a fourth processing unit. The first detecting unit is configured to detect whether a real-time traffic of a service request currently received by the sub-layer is greater than a traffic configuration threshold corresponding to an upper sub-layer or an access service layer in communication connection with the sub-layer, if it is detected that the traffic configuration threshold corresponding to the sub-layer cannot meet a current service requirement. And the first processing unit is used for sending early warning reminding information to the terminal equipment if the flow rate is larger than the preset flow rate, wherein the early warning reminding information is used for reminding a user to manually adjust the flow rate configuration value of the sub-hierarchy. A second processing unit, configured to determine whether the current adjustment amplitude of the sub-layer level is greater than a preset adjustment amplitude threshold if the current adjustment amplitude of the sub-layer level is not greater than the preset adjustment amplitude threshold. A third processing unit, configured to, if the current adjustment amplitude of the sub-layer is not greater than the adjustment amplitude threshold, perform an adjustment operation on the flow configuration threshold corresponding to the sub-layer according to the adjustment ratio. And the fourth processing unit is configured to send early warning notification information to the terminal device if the current adjustment amplitude of the sub-hierarchy is greater than the adjustment amplitude threshold, where the early warning notification information is used to notify a user of manually adjusting the flow configuration value of the sub-hierarchy.
Further, on the basis of any of the above embodiments, the access server hierarchy and each sub-hierarchy respectively correspond to a preset traffic configuration threshold. The monitoring parameters comprise detection frequency and trigger control rate threshold. The detection module comprises: the device comprises a second determining unit, an acquiring unit and a second judging unit. And the second determining unit is configured to determine, for each sub-tier, a real-time traffic of a service request currently received by the upper sub-tier or the access service tier and a current trigger control rate of the sub-tier according to the detection frequency. An obtaining unit, configured to obtain a current trigger control rate and a real-time traffic of the sub-level if it is detected that the real-time traffic corresponding to the upper sub-level or the access service level exceeds a traffic configuration threshold corresponding to the upper sub-level or the access service level, and a trigger control rate of the upper sub-level or the access service level in two detection processes exceeds a trigger control rate threshold corresponding to the upper sub-level or the access service level. And the second judging unit is used for judging that the current flow configuration threshold of the sub-layer exceeds the current service requirement if the current real-time flow of the sub-layer is detected to exceed the flow configuration threshold corresponding to the sub-layer and the trigger control rate is lower than a preset trigger control rate threshold.
Further, on the basis of any of the above embodiments, the adjustment parameters include an adjustment amplitude threshold value and an adjustment proportion. The processing module is configured to include: and a fifth processing unit, configured to, if it is detected that the traffic configuration threshold corresponding to the sub-layer exceeds the current service requirement, perform an adjustment operation according to the traffic configuration threshold corresponding to the adjustment proportion corresponding to the sub-layer.
Fig. 7 is a schematic structural diagram of an electronic device according to a fifth embodiment of the present disclosure, and as shown in fig. 7, the electronic device 700 may be a terminal device or a server. Among them, the terminal Device may include, but is not limited to, a mobile terminal such as a mobile phone, a notebook computer, a Digital broadcast receiver, a Personal Digital Assistant (PDA), a tablet computer (PAD), a Portable Multimedia Player (PMP), a car terminal (e.g., car navigation terminal), etc., and a fixed terminal such as a Digital TV, a desktop computer, etc. The electronic device shown in fig. 7 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.
As shown in fig. 7, the electronic device 700 may include a processing means (e.g., a central processing unit, a graphics processor, etc.) 701, which may perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) 702 or a program loaded from a storage means 708 into a Random Access Memory (RAM) 703. In the RAM 703, various programs and data necessary for the operation of the electronic apparatus 700 are also stored. The processing device 701, the ROM702, and the RAM 703 are connected to each other by a bus 704. An input/output (I/O) interface 705 is also connected to bus 704.
Generally, the following devices may be connected to the I/O interface 705: input devices 706 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; an output device 707 including, for example, a Liquid Crystal Display (LCD), a speaker, a vibrator, and the like; storage 708, including, for example, magnetic tape, hard disk, etc.; and a communication device 709. The communication means 709 may allow the electronic device 700 to communicate wirelessly or by wire with other devices to exchange data. While fig. 7 illustrates an electronic device 700 having various means, it is to be understood that not all illustrated means are required to be implemented or provided. More or fewer devices may alternatively be implemented or provided.
In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication means 709, or may be installed from the storage means 708, or may be installed from the ROM 702. The computer program, when executed by the processing device 701, performs the above-described functions defined in the methods of the embodiments of the present disclosure.
Yet another embodiment of the present disclosure further provides an electronic device, including: a memory, a processor;
a memory; a memory for storing the processor-executable instructions;
wherein the processor is configured to call program instructions in the memory to perform the traffic processing method according to any of the above embodiments.
Yet another embodiment of the present disclosure further provides a computer-readable storage medium, in which computer-executable instructions are stored, and when the computer-executable instructions are executed by a processor, the computer-readable storage medium is configured to implement the traffic processing method according to any one of the above embodiments.
Yet another embodiment of the present disclosure further provides a computer program product comprising a computer program, which when executed by a processor implements the traffic processing method according to any of the above embodiments.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working process of the apparatus described above may refer to the corresponding process in the foregoing method embodiment, and is not described herein again.
Those of ordinary skill in the art will understand that: all or a portion of the steps of implementing the above-described method embodiments may be performed by hardware associated with program instructions. The program may be stored in a computer-readable storage medium. When executed, the program performs steps comprising the method embodiments described above; and the aforementioned storage medium includes: various media that can store program codes, such as ROM, RAM, magnetic or optical disks.
Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the present disclosure, and not for limiting the same; while the present disclosure has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art will understand that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; such modifications or substitutions do not depart from the scope of the embodiments of the present disclosure by the essence of the corresponding technical solutions.
Claims (11)
1. The traffic processing method is applied to a distributed transaction platform, wherein the distributed transaction platform comprises an access service layer and at least one sub-layer in communication connection with the access service layer, the sub-layer comprises a service plate sub-layer, an application cluster sub-layer and a transaction scene sub-layer, the access server layer and each sub-layer respectively correspond to preset traffic prevention and control parameters, and the traffic prevention and control parameters comprise monitoring parameters and adjusting parameters; the method comprises the following steps:
aiming at each sub-level, respectively detecting the sub-level according to the monitoring parameters, or whether the sub-level and an upper sub-level or an access service level meet preset flow prevention and control conditions or not, and obtaining a detection result;
and dynamically adjusting the flow configuration threshold of the sub-level by adopting an adjustment parameter corresponding to the sub-level according to the detection result.
2. The method of claim 1, wherein the access server hierarchy level and each sub-hierarchy level respectively correspond to a preset traffic configuration threshold; the monitoring parameters comprise detection frequency and a trigger control rate threshold;
the detecting, for each sub-tier, whether the sub-tier, or the sub-tier and an upper sub-tier or an access service tier meets a preset traffic prevention and control condition according to the monitoring parameter, to obtain a detection result, includes:
for each sub-level, determining the real-time flow of the currently received service request of the sub-level and the current trigger control rate of the sub-level according to the detection frequency;
detecting whether the real-time flow exceeds a flow configuration threshold corresponding to the sub-level, and determining whether the trigger control rate of the sub-level in the two detection processes exceeds the trigger control rate threshold;
and if the fact that the real-time flow corresponding to the sub-level exceeds the flow configuration threshold corresponding to the sub-level and the trigger control rate of the sub-level in the two detection processes exceeds the trigger control rate threshold corresponding to the sub-level is detected, judging that the flow configuration threshold corresponding to the sub-level cannot meet the current service requirement.
3. The method of claim 2, wherein the adjustment parameters include an adjustment magnitude threshold and an adjustment scale;
the dynamically adjusting the flow configuration threshold of the sub-hierarchy by adopting the adjustment parameter corresponding to the sub-hierarchy according to the detection result includes:
if detecting that the traffic configuration threshold corresponding to the sub-hierarchy cannot meet the current service requirement, detecting whether the real-time traffic of the service request currently received by the sub-hierarchy is greater than a traffic configuration threshold corresponding to an upper sub-hierarchy or an access service hierarchy which is in communication connection with the sub-hierarchy;
if the flow configuration value is larger than the preset flow configuration value, sending early warning reminding information to terminal equipment, wherein the early warning reminding information is used for reminding a user of manually adjusting the flow configuration value of the sub-level;
if not, determining whether the current adjustment amplitude of the sub-layer level is larger than a preset adjustment amplitude threshold value;
if the current adjustment amplitude of the sub-layer level is not larger than the adjustment amplitude threshold, adjusting the flow configuration threshold corresponding to the sub-layer level according to the adjustment proportion;
and if the current adjustment amplitude of the sub-level is larger than the adjustment amplitude threshold, sending early warning reminding information to terminal equipment, wherein the early warning reminding information is used for reminding a user to manually adjust the flow configuration value of the sub-level.
4. The method of claim 1, wherein the access server hierarchy and each sub-hierarchy respectively correspond to a preset traffic configuration threshold; the monitoring parameters comprise detection frequency and a trigger control rate threshold;
the detecting, for each sub-tier, whether the sub-tier, or the sub-tier and an upper sub-tier or an access service tier meets a preset traffic prevention and control condition according to the monitoring parameter, to obtain a detection result, includes:
aiming at each sub-level, determining the real-time flow of a service request currently received by the upper sub-level or the access service level and the current trigger control rate of the sub-level according to the detection frequency;
if the real-time flow corresponding to the upper sub-level or the access service level exceeds the flow configuration threshold corresponding to the upper sub-level or the access service level and the trigger control rate of the upper sub-level or the access service level in the two detection processes exceeds the trigger control rate threshold corresponding to the upper sub-level or the access service level, acquiring the current trigger control rate and the real-time flow of the sub-level;
and if the fact that the current real-time flow of the sub-layer exceeds the flow configuration threshold corresponding to the sub-layer and the trigger control rate is lower than a preset trigger control rate threshold is detected, judging that the current flow configuration threshold of the sub-layer exceeds the current service requirement.
5. The method of claim 4, wherein the adjustment parameters include an adjustment amplitude threshold and an adjustment scale;
the dynamically adjusting the sub-level traffic configuration threshold by using the adjustment parameter corresponding to the sub-level according to the detection result includes:
and if the flow configuration threshold corresponding to the sub-level is detected to exceed the current service requirement, adjusting according to the flow configuration threshold corresponding to the adjustment proportion corresponding to the sub-level.
6. The method according to any one of claims 1-5, further comprising:
monitoring whether the real-time flow of a service request received by the access service level is larger than a flow configuration threshold value corresponding to the access service level or not in real time;
and if so, controlling the access service level to stop receiving the service request within a preset time range.
7. The method according to any of claims 1-5, wherein the access server hierarchy and each sub-hierarchy respectively correspond to a preset traffic configuration threshold; further comprising:
when the distributed transaction platform operates for the first time, detecting whether the real-time flow of the service request currently received by the access server level and each sub-level is larger than the flow configuration threshold value corresponding to the access server level and each sub-level in real time;
and if so, controlling the access server level and each sub-level to stop receiving the service request within a preset time range.
8. The traffic processing device is applied to a distributed transaction platform, wherein the distributed transaction platform comprises an access service layer and at least one sub-layer in communication connection with the access service layer, the sub-layer comprises a service plate sub-layer, an application cluster sub-layer and a transaction scene sub-layer, the access server layer and each sub-layer respectively correspond to preset traffic prevention and control parameters, and the traffic prevention and control parameters comprise monitoring parameters and adjusting parameters; the device comprises:
the detection module is used for respectively detecting the sub-levels according to the monitoring parameters aiming at each sub-level, or whether the sub-levels and the upper sub-levels or the access service levels meet preset flow prevention and control conditions or not, and obtaining a detection result;
and the processing module is used for dynamically adjusting the flow configuration threshold of the sub-level by adopting the adjustment parameters corresponding to the sub-level according to the detection result.
9. An electronic device, comprising: a memory, a processor;
a memory; a memory for storing the processor-executable instructions;
wherein the processor is configured to invoke program instructions in the memory to perform the traffic processing method of any of claims 1-7.
10. A computer-readable storage medium having computer-executable instructions stored thereon, which when executed by a processor, implement the traffic processing method of any one of claims 1-7.
11. A computer program product, characterized in that it comprises a computer program which, when being executed by a processor, implements a traffic processing method according to any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210408511.1A CN114785734B (en) | 2022-04-19 | 2022-04-19 | Flow processing method, flow processing device, flow processing equipment, computer readable storage medium and flow processing product |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210408511.1A CN114785734B (en) | 2022-04-19 | 2022-04-19 | Flow processing method, flow processing device, flow processing equipment, computer readable storage medium and flow processing product |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114785734A true CN114785734A (en) | 2022-07-22 |
| CN114785734B CN114785734B (en) | 2024-03-26 |
Family
ID=82431568
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210408511.1A Active CN114785734B (en) | 2022-04-19 | 2022-04-19 | Flow processing method, flow processing device, flow processing equipment, computer readable storage medium and flow processing product |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114785734B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120179503A1 (en) * | 2010-05-12 | 2012-07-12 | Winshuttle, Llc | Dynamic web services work flow system and method |
| US20190253488A1 (en) * | 2018-02-14 | 2019-08-15 | International Business Machines Corporation | Transaction process management by dynamic transaction aggregation |
| CN110971561A (en) * | 2018-09-28 | 2020-04-07 | 阿里巴巴集团控股有限公司 | Access request processing method, device and equipment |
| CN111817914A (en) * | 2020-06-30 | 2020-10-23 | 晨边高地(无锡)科技有限公司 | Medium-high frequency algorithm transaction interface intelligent system |
| CN112437018A (en) * | 2020-11-19 | 2021-03-02 | 百度在线网络技术（北京）有限公司 | Flow control method, device, equipment and storage medium for distributed cluster |
-
2022
- 2022-04-19 CN CN202210408511.1A patent/CN114785734B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120179503A1 (en) * | 2010-05-12 | 2012-07-12 | Winshuttle, Llc | Dynamic web services work flow system and method |
| US20190253488A1 (en) * | 2018-02-14 | 2019-08-15 | International Business Machines Corporation | Transaction process management by dynamic transaction aggregation |
| CN110971561A (en) * | 2018-09-28 | 2020-04-07 | 阿里巴巴集团控股有限公司 | Access request processing method, device and equipment |
| CN111817914A (en) * | 2020-06-30 | 2020-10-23 | 晨边高地(无锡)科技有限公司 | Medium-high frequency algorithm transaction interface intelligent system |
| CN112437018A (en) * | 2020-11-19 | 2021-03-02 | 百度在线网络技术（北京）有限公司 | Flow control method, device, equipment and storage medium for distributed cluster |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114785734B (en) | 2024-03-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8417239B1 (en) | Wireless device coverage mapping | |
| US10536322B2 (en) | Resource management for services | |
| CN112333556B (en) | Control method for monitoring video transmission bandwidth, terminal equipment and readable storage medium | |
| US11750711B1 (en) | Systems and methods for adaptively rate limiting client service requests at a blockchain service provider platform | |
| CN104980472A (en) | Network traffic control method and device | |
| CN110730424A (en) | Positioning method, device and system | |
| EP2661083A2 (en) | Video encoding system, method and computer readable medium thereof | |
| CN110071952B (en) | Service call quantity control method and device | |
| CN114785734B (en) | Flow processing method, flow processing device, flow processing equipment, computer readable storage medium and flow processing product | |
| EP3716659A1 (en) | Method for processing ordered broadcast and electronic device | |
| CN112965799A (en) | Task state prompting method and device, electronic equipment and medium | |
| CN104601725B (en) | The response method and device of service request | |
| CN115190180A (en) | Method and device for scheduling network resource request during sudden increase of network resource request | |
| CN112675535B (en) | Display interface adjusting method, device, network equipment and storage medium | |
| CN115118636A (en) | Method and device for determining network jitter state, electronic equipment and storage medium | |
| CN109815429B (en) | Browser page closing processing method and device | |
| CN114546910A (en) | Access control method, device, storage medium and electronic device | |
| EP3640821B1 (en) | Coefficient calculation method, component calling method, device, medium, server, and terminal | |
| CN112995265A (en) | Request distribution method and device and electronic equipment | |
| CN108111561B (en) | Data downloading method and equipment thereof | |
| CN112291797B (en) | Data processing method and device and electronic equipment | |
| CN115801104A (en) | Satellite transit prediction information acquisition method, device, medium and equipment | |
| CN117909056A (en) | Memory optimization method and device, intelligent equipment and computer readable storage medium | |
| CN117202146A (en) | Display control method, device and medium for NFC passive display equipment | |
| CN115330514A (en) | Loan behavior risk management method and device, computer equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |