CN114095432B - Method, system and storage medium for scheduling application flow partition - Google Patents
Method, system and storage medium for scheduling application flow partition Download PDFInfo
- Publication number
- CN114095432B CN114095432B CN202111361078.2A CN202111361078A CN114095432B CN 114095432 B CN114095432 B CN 114095432B CN 202111361078 A CN202111361078 A CN 202111361078A CN 114095432 B CN114095432 B CN 114095432B
- Authority
- CN
- China
- Prior art keywords
- label
- flow
- core
- partition
- shunting
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000005192 partition Methods 0.000 title claims abstract description 76
- 238000000034 method Methods 0.000 title claims abstract description 40
- 238000013507 mapping Methods 0.000 claims abstract description 26
- 238000006243 chemical reaction Methods 0.000 claims abstract description 20
- 238000012544 monitoring process Methods 0.000 claims description 14
- 235000014510 cooky Nutrition 0.000 claims description 4
- 238000012423 maintenance Methods 0.000 abstract description 4
- 230000000694 effects Effects 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 238000012800 visualization Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
- H04L47/24—Traffic characterised by specific attributes, e.g. priority or QoS
- H04L47/2483—Traffic characterised by specific attributes, e.g. priority or QoS involving identification of individual flows
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention discloses a method, a system and a storage medium for dispatching application flow partitions. A method for applying traffic partition scheduling for PaaS platforms, comprising: identifying a core shunt label according to the characteristics of the application system; identifying a logic shunt label according to the flow characteristics of the application system; setting a conversion rule of a logic shunting label and a core shunting label; dividing the flow into a plurality of flow partitions according to the partition rule of the core split labels; setting up a mapping rule of the flow partition and an application service cluster inlet; changing the configuration of a flow router according to the mapping rule of the flow partition, and generating an access log record; and acquiring the monitored flow distribution information and the running state information according to the access log record. The invention solves the problems of low management and maintenance efficiency, low continuity of a service system and the like by using the complexity of the existing problem flow partition route.
Description
Technical Field
The present invention relates to the field of cloud computing technologies, and in particular, to a method, a system, and a storage medium for traffic partition scheduling.
Background
With the popularization of cloud computing applications, in order to ensure high reliability and business continuity of online services, enterprises can release and deploy the applications into multiple different resource pool available areas of multiple clouds or the same cloud so as to realize disaster recovery of the applications across the resource pool available areas. Meanwhile, different systems have different flow characteristics, routing control requirements and partition rules, which brings challenges to flow distribution scheduling, and how to support and realize quick, real-time, flexible and automatic flow routing and distribution scheduling is a great difficulty facing the realization of high availability of PaaS (Platform as a Service) platform supporting application.
Disclosure of Invention
The invention provides a method, a system and a storage medium for dispatching application flow partition, which solve the problems of low management and maintenance efficiency, low continuity of a service system and the like by using the complexity of the existing problem flow partition routing.
In a first aspect, an embodiment of the present invention provides a method for scheduling application traffic partitions, configured to
A PaaS platform comprising:
identifying a core shunt label according to the characteristics of the application system;
identifying a logic shunt label according to the flow characteristics of the application system;
setting a conversion rule of a logic shunting label and a core shunting label;
dividing the flow into a plurality of flow partitions according to the partition rule of the core split labels;
setting up a mapping rule of the flow partition and an application service cluster inlet;
changing the configuration of a flow router according to the mapping rule of the flow partition, and generating an access log record;
and acquiring the monitored flow distribution information and the running state information according to the access log record.
Preferably, the application system core features include one or more of province areas and tenant names, and the core split labels are defined in integers or character strings.
Preferably, the characteristics of the current application system traffic are in the form of: one or more of http method, http header, cookie, and http url.
Preferably, the setting a conversion rule of the logic bypass label and the core bypass label specifically includes: the logic shunting label is converted into the core shunting label through a specified rule, and the conversion rule comprises one or more of the following:
converting into a specific core shunting label in an enumeration mode;
converting the character string prefix and the range into a specific core shunt label; and
and converting into a specific core shunting label in a hash mode.
Preferably, the dividing the traffic into a plurality of traffic partitions according to the partition rule of the core split label specifically includes:
the algorithm for configuring the mapping rule of the core split labels and the partitions comprises the following steps: one or more of hashing modulo, scoping, or prefixing.
Preferably, the mapping rule of the traffic partition and the application service cluster entrance is compiled;
further comprises: the visualization drag partition maps to the specified cluster service.
Preferably, the application service cluster exposes an interface to the outside through a declarative API.
Preferably, the acquiring monitored flow distribution information and running state information according to the access log record specifically includes receiving monitoring data from a flow monitoring queue according to the access log record, and acquiring monitored flow distribution information and running state information.
In a second aspect, an embodiment of the present invention further provides a system for applying traffic partition scheduling, including:
the identification core tag module is used for identifying a core split tag according to the characteristics of the application system;
the identification logic tag module is used for identifying a logic shunt tag according to the flow characteristics of the application system;
the conversion module is used for setting the conversion rule of the logic shunt label and the core shunt label;
the partition module is used for dividing the flow into a plurality of flow partitions according to the partition rule of the core split labels;
the mapping rule module is used for compiling the mapping rule of the flow partition and the application service cluster entrance;
the route setting module is used for changing the configuration of the flow router according to the mapping rule of the flow partition and generating an access log record;
and the monitoring module is used for acquiring the monitored flow distribution information and the running state information according to the access log record.
In a third aspect, an embodiment of the present invention further provides a computer storage medium, where an instruction is stored, where the instruction executes a method for applying traffic partition scheduling according to the first aspect.
The invention has the following beneficial effects:
the invention provides a standard flow partition routing scheduling method, which supports unified flow distribution scheduling of a plurality of application system clusters, eliminates single-point faults, improves the reliability and throughput of an application system, effectively reduces the complexity of flow partition routing, improves management and maintenance efficiency, and ensures the continuity of a service system. The method can be used for traffic distribution and scheduling in scenes such as co-city double-activity, off-site double-activity, application cross-cluster operation, application cross-environment operation, application system cross-cloud and the like.
Compared with the dns and other technologies, the flow partition scheduling function is realized through software, and the interface is exposed to the outside through the declarative API, so that online change can take effect in real time, and convenient management and visualization can be realized; compared with the traditional load balancing technology, the method and the device abstract an upper layer flow partition scheduling model, and can flexibly support application flows of different special types.
Drawings
FIG. 1 is a flow chart of a method for traffic partition scheduling in accordance with a first embodiment of the present invention;
fig. 2 is a block diagram of a system for traffic partition scheduling according to a second embodiment of the present invention.
Detailed Description
The invention is described in further detail below with reference to the drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting thereof. It should be further noted that, for convenience of description, only some, but not all of the structures related to the present invention are shown in the drawings.
Fig. 1 is a flowchart of a method for traffic partition scheduling according to an embodiment of the present invention, where the embodiment is applicable to PaaS platforms, and the method may be executed by a server, a cloud computing platform, a computer, etc., and specifically includes the following steps:
step 110, identifying the core split labels according to the application system characteristics.
The core features of the application system comprise one or more of province areas and tenant names, and the core shunt labels are defined in integer or character string types.
The current application system traffic characteristics are in the form of: one or more of http method, http header, cookie, and http url.
Step 120, identifying the logic shunt label according to the flow characteristics of the application system.
Step 130, setting a conversion rule of the logic shunting label and the core shunting label.
Preferably, the conversion rule specifically includes: the logic shunting label is converted into the core shunting label through a specified rule, and the conversion rule comprises one or more of the following:
converting into a specific core shunting label in an enumeration mode;
converting the character string prefix and the range into a specific core shunt label; and
and converting into a specific core shunting label in a hash mode.
And 140, dividing the flow into a plurality of flow partitions according to the partition rule of the core split labels.
The algorithm for configuring the mapping rule of the core split labels and the partitions comprises the following steps: one or more of hashing modulo, scoping, or prefixing.
And 150, compiling a mapping rule of the flow partition and the application service cluster entrance.
Preferably, the method further comprises: the visualized drag traffic partition maps to a specified cluster service.
And the application service cluster externally exposes an interface through a declarative API.
And 160, changing the configuration of the flow router according to the mapping rule of the flow partition, and generating an access log record.
Specifically, a traffic route changing task is created, the configuration of a traffic router is changed according to the mapping rule of the traffic partition, definition and management functions of a traffic related pipeline, filter, controller object are provided, and a traffic running log and traffic monitoring data are output to a traffic monitoring queue; .
And step 170, acquiring the monitored flow distribution information and the running state information according to the access log record.
In this embodiment, specifically, according to the access log record, monitoring data is received from the flow monitoring queue, and monitored flow distribution information and running state information are obtained.
Fig. 2 is a block diagram of a system for applying traffic partition scheduling according to an embodiment of the present invention, where the embodiment is applicable to PaaS platforms, and the system may be formed by a server, a cloud computing platform, a computer, and the like, and includes an identification core tag module 310, an identification logic tag module 320, a conversion module 330, a partition module 340, a mapping rule module 350, a route setting module 360, and a monitoring module 370.
An identification core tag module 310, configured to identify a core split tag according to an application system feature;
an identification logic tag module 320, configured to identify a logic bypass tag according to the traffic characteristics of the application system;
a conversion module 330, configured to set a conversion rule of the logic bypass label and the core bypass label;
the partition module 340 is configured to divide the traffic into a plurality of traffic partitions according to the partition rule of the core split label;
a mapping rule module 350, configured to compile a mapping rule of the traffic partition and an application service cluster entry;
a route setting module 360, configured to change a traffic router configuration according to the mapping rule of the traffic partition, and generate an access log record;
and the monitoring module 370 is configured to obtain monitored flow distribution information and running state information according to the access log record.
The core features of the application system comprise one or more of province areas and tenant names, and the core shunt labels are defined in integer or character string types.
The current application system flow characteristics are in the form of: one or more of http method, http header, cookie, and http url.
The transformation model 330 is specifically used for: the logic shunting label is converted into the core shunting label through a specified rule, and the conversion rule comprises one or more of the following:
converting into a specific core shunting label in an enumeration mode;
converting the character string prefix and the range into a specific core shunt label; and
and converting into a specific core shunting label in a hash mode.
In partition module 340, the algorithm for configuring the mapping rule of the core split label and the partition includes: one or more of hashing modulo, scoping, or prefixing.
The mapping rule module is also used for visually dragging the traffic partition to be mapped to the appointed cluster service.
And the application service cluster externally exposes an interface through a declarative API.
The monitoring module 370 is specifically configured to receive monitoring data from the traffic monitoring queue according to the access log record, and obtain monitored traffic distribution information and running state information.
Therefore, a system for applying traffic partition scheduling can also achieve the corresponding technical effects of a method for applying traffic partition scheduling, and the foregoing has been described in detail, which is not repeated herein.
Accordingly, an embodiment of the present invention further provides a computer readable storage medium, where instructions are stored, where the instructions execute any one of the methods for scheduling application traffic partitions provided in the foregoing embodiment during running, so that corresponding technical effects can also be achieved, and the foregoing details are not repeated herein.
In summary, the method, the system and the storage medium for traffic partition scheduling of the application support unified traffic distribution scheduling of a plurality of application system clusters, eliminate single-point faults, improve the reliability and throughput of the application system, effectively reduce the complexity of traffic partition routing, improve the management and maintenance efficiency, and ensure the continuity of the service system. The method can be used for traffic distribution and scheduling in scenes such as co-city double-activity, off-site double-activity, application cross-cluster operation, application cross-environment operation, application system cross-cloud and the like.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) comprising instructions for causing a terminal device (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the method according to the embodiments of the present invention.
The foregoing description is only of the preferred embodiments of the present invention, and is not intended to limit the scope of the invention, but rather is intended to cover any equivalents of the structures or equivalent processes disclosed herein or in the alternative, which may be employed directly or indirectly in other related arts.
Claims (9)
1. A method for traffic partition scheduling for PaaS platforms, comprising:
identifying a core shunt label according to the characteristics of the application system;
identifying a logic shunt label according to the flow characteristics of the application system;
setting a conversion rule of a logic shunting label and a core shunting label; the setting of the conversion rule of the logic shunting label and the core shunting label specifically comprises the following steps: the logic shunting label is converted into the core shunting label through a specified rule, and the conversion rule comprises one or more of the following: converting into a specific core shunting label in an enumeration mode; converting the character string prefix and the range into a specific core shunt label; and converting into a specific core shunting label in a hash mode;
dividing the flow into a plurality of flow partitions according to the partition rule of the core split labels;
setting up a mapping rule of the flow partition and an application service cluster inlet;
changing the configuration of a flow router according to the mapping rule of the flow partition, and generating an access log record;
and acquiring the monitored flow distribution information and the running state information according to the access log record.
2. The method of claim 1, wherein the application system core features include one or more of a province area and a tenant name, and the core split labels are defined in terms of an integer or a type of character string.
3. The method of claim 1, wherein the characteristic of the current application system traffic is in the form of: one or more of http method, http header, cookie, and http url.
4. The method according to claim 1, wherein the dividing the traffic into a plurality of traffic partitions according to the partition rule of the core split tag specifically comprises:
the algorithm for configuring the mapping rule of the core split labels and the partitions comprises the following steps: one or more of hashing modulo, scoping, or prefixing.
5. The method of claim 4, wherein the mapping rules for traffic partitions and application service cluster entries are programmed;
further comprises: the visualized drag traffic partition maps to a specified cluster service.
6. The method of claim 5, wherein the application service cluster exposes interfaces to the outside through a declarative API.
7. The method according to claim 1, wherein the obtaining monitored flow distribution information and operation state information according to the access log record specifically includes receiving monitored data from a flow monitoring queue according to the access log record, and obtaining monitored flow distribution information and operation state information.
8. A system for applying traffic partition scheduling, comprising:
the identification core tag module is used for identifying a core split tag according to the characteristics of the application system;
the identification logic tag module is used for identifying a logic shunt tag according to the flow characteristics of the application system;
the conversion module is used for setting the conversion rule of the logic shunt label and the core shunt label; the setting of the conversion rule of the logic shunting label and the core shunting label specifically comprises the following steps: the logic shunting label is converted into the core shunting label through a specified rule, and the conversion rule comprises one or more of the following: converting into a specific core shunting label in an enumeration mode; converting the character string prefix and the range into a specific core shunt label; and converting into a specific core shunting label in a hash mode;
the partition module is used for dividing the flow into a plurality of flow partitions according to the partition rule of the core split labels;
the mapping rule module is used for compiling the mapping rule of the flow partition and the application service cluster entrance;
the route setting module is used for changing the configuration of the flow router according to the mapping rule of the flow partition and generating an access log record;
and the monitoring module is used for acquiring the monitored flow distribution information and the running state information according to the access log record.
9. A computer storage medium having stored therein instructions which, when executed, perform a method of applying traffic partition scheduling according to any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111361078.2A CN114095432B (en) | 2021-12-22 | 2021-12-22 | Method, system and storage medium for scheduling application flow partition |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111361078.2A CN114095432B (en) | 2021-12-22 | 2021-12-22 | Method, system and storage medium for scheduling application flow partition |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114095432A CN114095432A (en) | 2022-02-25 |
| CN114095432B true CN114095432B (en) | 2024-03-19 |
Family
ID=80301248
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111361078.2A Active CN114095432B (en) | 2021-12-22 | 2021-12-22 | Method, system and storage medium for scheduling application flow partition |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114095432B (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109462534A (en) * | 2017-09-06 | 2019-03-12 | 中国银联股份有限公司 | Regional internet controller, regional internet control method and computer storage medium |
| CN109495392A (en) * | 2018-10-31 | 2019-03-19 | 泰康保险集团股份有限公司 | Message conversion process method and device, electronic equipment, storage medium |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9959421B2 (en) * | 2014-06-23 | 2018-05-01 | Oracle International Corporation | System and method for monitoring and diagnostics in a multitenant application server environment |
-
2021
- 2021-12-22 CN CN202111361078.2A patent/CN114095432B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109462534A (en) * | 2017-09-06 | 2019-03-12 | 中国银联股份有限公司 | Regional internet controller, regional internet control method and computer storage medium |
| CN109495392A (en) * | 2018-10-31 | 2019-03-19 | 泰康保险集团股份有限公司 | Message conversion process method and device, electronic equipment, storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114095432A (en) | 2022-02-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9712402B2 (en) | Method and apparatus for automated deployment of geographically distributed applications within a cloud | |
| US8265973B2 (en) | Analytic-based scaling of information technology resources | |
| CN107465765B (en) | Intelligent application gateway implementation method based on container cloud | |
| CN110661842B (en) | Resource scheduling management method, electronic equipment and storage medium | |
| CN112671582B (en) | Artificial intelligence reasoning method and system based on edge reasoning cluster | |
| Azizi et al. | A priority-based service placement policy for fog-cloud computing systems | |
| CN107395674A (en) | A kind of application system accesses the method and device of isomery block platform chain | |
| US10042915B2 (en) | Semantic mapping of topic map meta-models identifying assets and events to include directionality | |
| CN105933154A (en) | Management method of cloud calculation resources | |
| CN113114552A (en) | Method and equipment for providing network for virtual machine and container in cloud platform | |
| CN114095432B (en) | Method, system and storage medium for scheduling application flow partition | |
| US10242349B1 (en) | Efficient scheduling of maintenance for power distribution systems | |
| CN113806097A (en) | Data processing method and device, electronic equipment and storage medium | |
| WO2019087382A1 (en) | Operation state prediction system, operation state prediction method, and operation state prediction program | |
| CN108234598A (en) | A kind of network communication applied to power industry controls management method | |
| CN111813503A (en) | Micro-service application open system based on container cloud | |
| CN115270947A (en) | Standardized energy efficiency service model construction method, system, terminal and storage medium | |
| CN109995571A (en) | Server configuration applies matched method and device with VNF | |
| CN112330202B (en) | Control intention work order processing method based on arrangement control flow service fulfillment | |
| CN114070889A (en) | Configuration method, traffic forwarding method, device, storage medium, and program product | |
| CN114756301A (en) | Log processing method, device and system | |
| CN110891239B (en) | PNF configuration and PNFD TOSCA implementation method and device | |
| CN112114833A (en) | Device and method for determining middleware installation and deployment | |
| Azizi et al. | A QoS-aware service placement algorithm for fog-cloud computing environments | |
| US10545802B2 (en) | Event loop optimization through event ordering |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |