CN113507421A - High-performance refined shunting method based on application - Google Patents
High-performance refined shunting method based on application Download PDFInfo
- Publication number
- CN113507421A CN113507421A CN202110636500.4A CN202110636500A CN113507421A CN 113507421 A CN113507421 A CN 113507421A CN 202110636500 A CN202110636500 A CN 202110636500A CN 113507421 A CN113507421 A CN 113507421A
- Authority
- CN
- China
- Prior art keywords
- message
- messages
- data message
- information base
- classification
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims description 20
- 230000000875 corresponding effect Effects 0.000 claims abstract description 19
- 230000009471 action Effects 0.000 claims description 22
- 230000011664 signaling Effects 0.000 claims description 11
- 238000004590 computer program Methods 0.000 claims description 7
- 230000002452 interceptive effect Effects 0.000 claims description 7
- 238000012545 processing Methods 0.000 description 8
- 238000012216 screening Methods 0.000 description 6
- 230000008901 benefit Effects 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000007246 mechanism Effects 0.000 description 3
- 230000007547 defect Effects 0.000 description 2
- 238000005265 energy consumption Methods 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000032683 aging Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
- H04L47/24—Traffic characterised by specific attributes, e.g. priority or QoS
- H04L47/2441—Traffic characterised by specific attributes, e.g. priority or QoS relying on flow classification, e.g. using integrated services [IntServ]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
- H04L47/24—Traffic characterised by specific attributes, e.g. priority or QoS
- H04L47/2483—Traffic characterised by specific attributes, e.g. priority or QoS involving identification of individual flows
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention discloses an application-based refined distribution system, which comprises a basic distribution module, a user context information base and a basic distribution module, wherein the basic distribution module is used for receiving and identifying messages, including control messages and data messages, and maintaining the user context information base according to the control messages; matching and associating the data message with a user context information base, marking the data message, and searching the marked data message according to basic classification rules; performing shunting judgment on the messages returned by the refined classification module and executing corresponding actions; and the refined classification module is used for classifying the first N packets of the data message corresponding to the flow which does not hit the basic classification rule, and the original data message and the classification result are combined into a message returned by the refined classification module. The data message is marked by the user information, can be accurately shunted according to the user information, is added with refined shunting, can unload low-value flow through the refined shunting based on application shunting, reduces the performance pressure of a back-end service system, and achieves the aim of high-performance refined shunting.
Description
Technical Field
The invention relates to network communication shunting, in particular to a high-performance refined shunting method based on application.
Background
The mobile internet traffic is increasing day by day, the traffic accessed by a mobile internet system is increased by 50% -100% every year, the existing analysis system can not process the full traffic again in consideration of factors such as space, energy consumption and capital, the current front-end equipment can only classify according to an IP layer, the identification and screening capability is weak, the shunt granularity is not fine, the capability of screening and data identification according to an application layer is lacked, and a large amount of low-value traffic flows to a back-end system.
In the prior art, patent CN109768936A discloses a refined shunting system and shunting method, which make up for the defect of coarse granularity classified based on an IP layer, but the patent still has the following two problems: firstly, the method is not fine enough, and does not have the information classification and traceability of mobile internet terminal users. Secondly, because the full flow is copied to the deep packet recognition engine, the processing capacity of the deep packet recognition engine is limited, and compromises in the aspects of energy consumption, space, cost and the like are necessarily made.
Disclosure of Invention
The purpose of the invention is as follows: aiming at the defects, the invention adopts an application-based refined distribution system which adds refined distribution on the basis of the original basic distribution and screens data according to user information.
The invention also provides a refined shunting method based on the application.
The technical scheme is as follows: in order to solve the above problems, the present invention provides an application-based refined flow distribution system, including:
the basic distribution module is used for receiving and identifying messages, including control messages and data messages, and maintaining a user context information base according to the control messages; matching and associating the data message with a user context information base, marking the data message, and searching the marked data message according to basic classification rules; performing shunting judgment on the messages returned by the refined classification module and executing corresponding actions;
and the refined classification module is used for classifying the first N packets of the data message corresponding to the flow which does not hit the basic classification rule, and the original data message and the classification result are combined into a message returned by the refined classification module.
Has the advantages that: compared with the prior art, the method has the obvious advantages that the data message is associated with the user context information base, the data message is marked through the user information, the shunting can be accurately performed according to the user information, in addition, a refined shunting function is added to the front-end shunting equipment, the shunting can be performed based on application types, audios and videos, texts, pictures and the like, the low-value flow is unloaded on the front-end shunting equipment through the refined shunting capacity, the flow is shunted to the rear-end analysis system as required, the performance pressure of the rear-end service system is reduced, and the aim of high-performance refined shunting is fulfilled.
Further, the messages received by the basic distribution module include control messages, return messages of the fine classification module, association messages and data messages.
The system further comprises a signaling analysis module used for extracting the user information of the control message sent by the basic distribution module and establishing a correlation message to inform the basic distribution module to maintain the user context information base.
Further, the user context information base comprises a primary information base and a secondary information base, the primary information base is a bearing information base and comprises a bearing tunnel ID and a tunnel IP address, the secondary information base is a user information base, and the user information base stores user information.
The invention also adopts a refined shunting method based on application, which comprises the following steps:
(1) receiving and identifying messages, including control messages and data messages, and maintaining a user context information base according to the control messages;
(2) matching and associating the data message with a user context information base, marking the data message, and searching the marked data message according to basic classification rules;
(3) classifying the first N packets of the data message corresponding to the flow which does not hit the basic classification rule, and combining the original data message and the classification result into a refined classification module to return a message;
(4) and carrying out shunting judgment on the returned message of the refined classification module and executing corresponding action.
Further, the step (1) specifically comprises the following steps:
(1.1) receiving mass messages of the mobile Internet and interactive messages in the system;
(1.2) identifying the received message and the interactive message, comprising the following steps: the control message, the data message and the refined classification module return messages and associated messages;
(1.3) carrying out shunting action judgment on the control message, mirroring one control message if the shunting action exists, carrying out step (1.4) on the mirrored control message, carrying out shunting judgment on the original control message and executing corresponding action; if the shunting action does not exist, executing the step (1.4) on the control message;
(1.4) extracting user information from the control message and establishing a correlation message;
and (1.5) maintaining the user context information base according to the association message, wherein the user context information base is added, deleted and updated.
Further, the step (2) specifically includes the following steps:
(2.1) matching and associating the data message with the user context information base, if the data message hits the user context information base, marking the data message, and performing the step (2.2) on the marked data message; if the data message does not hit the user context information base, the data message directly goes to the step (2.2);
and (2.2) searching the basic classification rule of the data message, if the basic classification rule is hit, performing shunt judgment and executing corresponding action, and if the basic classification rule is not hit, performing the step (3).
Further, in the step (3), the first N packets of the stream corresponding to the data message are subjected to application classification, content classification and http/https metadata classification, wherein the content in the content classification includes a text, a picture, and an audio/video, and the classification result includes a flow splitting action.
Drawings
FIG. 1 is a flowchart illustrating the operation of a refined shunting system of the present invention;
fig. 2 shows the overall format of TLV tag encoded in TLV when the user information is encapsulated in the message.
Detailed Description
As shown in fig. 1, the application-based refined distribution system in this embodiment includes a basic distribution module, a signaling analysis module, and a refined classification module, and this embodiment mainly provides a cooperative processing mechanism. Firstly, signaling analysis and data association cooperative processing are performed, and user association information is provided for data through an association message notification mechanism. And the data is associated by inquiring the user information of the information base. Secondly, the flow of the failed basic classification dispatches part of the messages to a refined classification module through the basic classification module, the pretreatment of the refined classification is further completed, and the original messages carry classification results and return to the basic classification module to complete information recording.
The basic distribution module is responsible for receiving internet traffic, including signaling messages (namely control messages) and data messages; after identifying the internet flow, the basic shunting module sends the control message to the signaling analysis module, the signaling analysis module analyzes the control message to obtain the user information (three-code information < IMSI, MSISDN, IMEI > and position information), establishes the association message according to the obtained user information, the basic shunting module also receives the association message, and the signaling analysis module triggers the basic classification module to maintain the user context information base through the association message notification mechanism. A single user may simultaneously allocate multiple bearers, and in order to improve the utilization rate of the memory, in this embodiment, a manner of hierarchical storage of the user context information base is adopted to correspond to a one-to-many mapping relationship. The user context information base comprises a primary information base and a secondary information base, wherein the primary information base is a bearing information base bearing tunnel ID and tunnel IP address, the bearing tunnel ID and the tunnel IP address are used as indexes of the user context information base, the secondary information base is a user information base, IMSI/SUPI is key values of the secondary information base, and the primary information base and the secondary information base support aging refreshing of data.
After identifying the internet traffic, the basic flow distribution module extracts the bearing tunnel ID and the tunnel IP address of the data message, and searches a matched user context information base according to the bearing tunnel ID and the tunnel IP address; marking the data message associated with the user information, and after the data message is associated with the user information, according to configuration, encapsulating some concerned user information in a header or a tail of the message according to a certain format, as shown in fig. 2, where the data message carries the user information through a TLV tag, where:
length of label: 2 bytes, identifying the "tag portion" total length;
TLV length: 1 byte to indicate a "TLV tag" length;
TLV tag content: the label content is encoded in TLV mode.
According to the principle of 'full access and on-demand processing' of the mobile internet traffic, a refined acquisition and distribution technology with application layer screening capacity is provided, a solution for classified screening of the traffic is formulated, the access processing performance of a single device is improved, and the traffic processed by a service system is reduced.
The basic distribution module searches the basic classification rule of the marked data message; the basic classification comprises classification of supporting three codes, positions and APN (DNN) for the associated data message based on five-element, load characteristics and signaling types. And inquiring the shunting action of the data message according to the three codes and the position of the user information in the marked data message, the APN (access point name) (DNN), the five-element information and the characteristic code information, and scheduling the first N packets of the data message which is not inquired about the shunting action corresponding to the flow to a fine classification module to realize the aim of fine shunting, wherein the basic shunting module can configure the maximum number of the messages which are scheduled to the fine classification module.
The refined classification module classifies the data messages dispatched by the basic distribution module, and comprises application classification, content (text, pictures and audio/video) classification and http/https metadata (method, url, host and sni) classification. And the refined classification module returns the classification result to the basic distribution module along with the original message. The original data message and the classification result are combined into a refined classification module to return a message, and the classification result comprises a shunting action correspondingly executed by the original data message. And the basic distribution module receives the return message of the refined classification module, performs action query on the return message of the refined classification module, determines distribution action according to a query result, and simultaneously records the classification result of the flow.
And the basic classification module judges the execution action of the message according to the action result of the control message, the data message and the refined classification module returned back to the message, if the action result is a shunting action, the message is transferred out from the specified port, and otherwise, the message is discarded.
The modules cooperate to complete the refined shunting function of the mobile internet flow, so that the aim of realizing refined shunting by front-end shunting equipment is fulfilled. Meanwhile, the network processor has the advantage of massive concurrent processing, and the processing capacity of fine shunting is improved.
In this embodiment, a flow distribution method for a refined flow distribution system based on an application includes the following steps:
(1) the basic flow distribution module receives mass flow of the mobile internet, wherein the mass flow comprises a control message and a data message; the basic distribution module receives interactive messages in the system, and the interactive messages comprise return messages and associated messages of the refined classification module;
(2) the basic distribution module identifies the received messages and interactive messages, and comprises the following steps: the control message and the refined classification module return messages, associated messages and data messages;
(3) establishing a user context information base;
(3.1) the basic shunting module carries out shunting action judgment on the control message, judges whether the control message needs signaling shunting, mirrors one control message if the control message has shunting action, carries out step (3.2) on the mirrored control message, carries out shunting judgment on the original control message and executes corresponding action; if the shunting action does not exist, executing the step (3.2) on the control message;
(3.2) the signaling analysis module receives the control message sent by the basic distribution module, analyzes the control message to obtain user information (three-code information < IMSI, MSISDN, IMEI > and position information, etc.), establishes a correlation message according to the obtained user information, and informs the basic distribution module through the correlation message;
(3.3) the basic distribution module obtains user information according to the association message, and maintains a user context information base through the borne tunnel ID and the IP address of the tunnel, including adding, deleting and updating the user context information base;
(4) the basic distribution module processes media surface data flow (namely data message), searches in a user context information base through a loaded tunnel ID and an IP address of the tunnel, matches and associates the data message with the user context information base, if the data message hits the user context information base, marks the data message, encapsulates some concerned user information at the head or the tail of the message according to a certain format according to configuration, and performs step (5) on the marked data message; if the data message does not hit the user context information base, the data message directly goes to the step (5);
(5) searching the basic classification rule of the data message, if the basic classification rule is hit, performing the step (7), and if the basic classification rule is not hit, performing the step (6);
(6) the refined basic distribution module identifies the application, content and metadata of the first N packets of the corresponding stream of the data message, combines the original data message and the classification result into a return message of the refined classification module, sends the return message of the refined classification module to the basic distribution module, and records the classification result of the stream;
(7) and the basic shunting module judges the execution action of the control message, the return message of the refined classification module and the data message, if the control message and the return message are shunting action, the messages are transferred out from the specified port, and otherwise, the messages are discarded.
The mobile internet data flow enters the shunting equipment, besides the traditional user flow five-element information shunting, the mobile internet data flow can be shunted according to the three codes, the position and the APN of a user, in addition, a refined shunting function is added to the front-end shunting equipment, and shunting can be performed based on application types, audios and videos, texts, pictures and the like. According to the fine acquisition and distribution of the application layer screening capacity, a solution for classified screening of the flow is formulated, the access processing performance of the single device is improved, and the flow processed by a service system is reduced.
The embodiment also provides an embodiment of a computer device, which includes a memory, a processor, and a computer program stored in the memory and capable of running on the processor, and when the processor executes the computer program, the steps of the application-based refinement and offloading method are implemented.
The present embodiment also provides an embodiment of a readable storage medium, on which a computer program is stored, and the computer program, when executed by a processor, implements the steps of the application-based refinement splitting method.
Claims (10)
1. An application-based refined distribution system, comprising:
the basic distribution module is used for receiving and identifying messages, including control messages and data messages, and maintaining a user context information base according to the control messages; matching and associating the data message with a user context information base, marking the data message, and searching the marked data message according to basic classification rules; performing shunting judgment on the messages returned by the refined classification module and executing corresponding actions;
and the refined classification module is used for classifying the first N packets of the data message corresponding to the flow which does not hit the basic classification rule, and the original data message and the classification result are combined into a message returned by the refined classification module.
2. The refinement flow distribution system according to claim 1, wherein the messages received by the basic flow distribution module include control messages, refinement classification module return messages, association messages, and data messages.
3. The refinement flow distribution system according to claim 2, further comprising a signaling analysis module, configured to extract user information from the control packet sent by the basic flow distribution module, and establish a correlation message to notify the basic flow distribution module to maintain a user context information base.
4. The refinement flow system of claim 3, wherein the user context information base comprises a primary information base and a secondary information base, the primary information base is a bearer information base comprising a bearer tunnel ID and a tunnel IP address, the secondary information base is a user information base, and the user information base stores user information.
5. A refined shunting method based on application is characterized by comprising the following steps:
(1) receiving and identifying messages, including control messages and data messages, and maintaining a user context information base according to the control messages;
(2) matching and associating the data message with a user context information base, marking the data message, and searching the marked data message according to basic classification rules;
(3) classifying the first N packets of the data message corresponding to the flow which does not hit the basic classification rule, and combining the original data message and the classification result into a refined classification module to return a message;
(4) and carrying out shunting judgment on the returned message of the refined classification module and executing corresponding action.
6. The refinement flow dividing method according to claim 5, wherein the step (1) specifically includes the steps of:
(1.1) receiving mass messages of the mobile Internet and interactive messages in the system;
(1.2) identifying the received message and the interactive message, comprising the following steps: the control message, the data message and the refined classification module return messages and associated messages;
(1.3) carrying out shunting action judgment on the control message, mirroring one control message if the shunting action exists, carrying out step (1.4) on the mirrored control message, carrying out shunting judgment on the original control message and executing corresponding action; if the shunting action does not exist, executing the step (1.4) on the control message;
(1.4) extracting user information from the control message and establishing a correlation message;
and (1.5) maintaining the user context information base according to the association message, wherein the user context information base is added, deleted and updated.
7. The refinement flow dividing method according to claim 5, wherein the step (2) specifically includes the steps of:
(2.1) matching and associating the data message with the user context information base, if the data message hits the user context information base, marking the data message, and performing the step (2.2) on the marked data message; if the data message does not hit the user context information base, the data message directly goes to the step (2.2);
and (2.2) searching the basic classification rule of the data message, if the basic classification rule is hit, performing shunt judgment and executing corresponding action, and if the basic classification rule is not hit, performing the step (3).
8. The refinement shunting method according to claim 5, wherein in the step (3), the first N packets of the data message corresponding stream are subjected to application classification, content classification and http/https metadata classification, wherein the content in the content classification includes text, pictures, and audio/video, and the classification result includes shunting action.
9. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the steps of the method according to any of claims 5 to 8 are implemented by the processor when executing the computer program.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 5 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110636500.4A CN113507421B (en) | 2021-06-08 | 2021-06-08 | High-performance refined distribution method based on application |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110636500.4A CN113507421B (en) | 2021-06-08 | 2021-06-08 | High-performance refined distribution method based on application |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113507421A true CN113507421A (en) | 2021-10-15 |
| CN113507421B CN113507421B (en) | 2024-07-12 |
Family
ID=78009130
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110636500.4A Active CN113507421B (en) | 2021-06-08 | 2021-06-08 | High-performance refined distribution method based on application |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113507421B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114205856A (en) * | 2021-11-27 | 2022-03-18 | 国家计算机网络与信息安全管理中心 | Signaling analysis device and signaling analysis method |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150363694A1 (en) * | 2013-01-16 | 2015-12-17 | Tata Consultancy Services Limited | A system and method for smart public alerts and notifications |
| CN108234315A (en) * | 2016-12-21 | 2018-06-29 | 青岛祥智电子技术有限公司 | Image network flow control protocol in a kind of virtualized network environment |
| CN108881033A (en) * | 2018-06-20 | 2018-11-23 | 湖南戎腾网络科技有限公司 | Highspeed user's source tracing method towards LTE network based on FPGA+NPU |
| CN111404798A (en) * | 2020-03-09 | 2020-07-10 | 湖北微源卓越科技有限公司 | System and method for multi-user rule matching and flow replication |
-
2021
- 2021-06-08 CN CN202110636500.4A patent/CN113507421B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150363694A1 (en) * | 2013-01-16 | 2015-12-17 | Tata Consultancy Services Limited | A system and method for smart public alerts and notifications |
| CN108234315A (en) * | 2016-12-21 | 2018-06-29 | 青岛祥智电子技术有限公司 | Image network flow control protocol in a kind of virtualized network environment |
| CN108881033A (en) * | 2018-06-20 | 2018-11-23 | 湖南戎腾网络科技有限公司 | Highspeed user's source tracing method towards LTE network based on FPGA+NPU |
| CN111404798A (en) * | 2020-03-09 | 2020-07-10 | 湖北微源卓越科技有限公司 | System and method for multi-user rule matching and flow replication |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114205856A (en) * | 2021-11-27 | 2022-03-18 | 国家计算机网络与信息安全管理中心 | Signaling analysis device and signaling analysis method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113507421B (en) | 2024-07-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20210233319A1 (en) | Context-aware tagging for augmented reality environments | |
| KR101494143B1 (en) | Radio resource optimization method, device and system | |
| CN101374234B (en) | Method and apparatus for monitoring video copy base on content | |
| CN107679560B (en) | Data transmission method and device, mobile terminal and computer readable storage medium | |
| US20110125748A1 (en) | Method and Apparatus for Real Time Identification and Recording of Artifacts | |
| CN113438642B (en) | 5G-oriented user traceability association method and system | |
| CN111970215B (en) | Data packet management method and device | |
| US20140214824A1 (en) | Method, device and computer storage medium for adding information of friends | |
| CN110351202B (en) | 5G core network traffic grouping method, device, equipment and computer storage medium | |
| CN114258052B (en) | Data association system, data association method, device, equipment and medium | |
| CN113507421A (en) | High-performance refined shunting method based on application | |
| CN105978748A (en) | Terminal equipment information counting method and terminal equipment information counting device based on Hash node | |
| CN116340055B (en) | Data recovery method and system for solid state disk | |
| CN111182577A (en) | CDR synthesis monitoring system and method suitable for 5G road tester | |
| CN101355719B (en) | Method, apparatus and system for processing multimedia information | |
| CN101771620A (en) | Method for realizing content downloading as well as system and device therefor | |
| CN110598042A (en) | Incremental update-based video structured real-time updating method and system | |
| CN111061453B (en) | Voice interaction method and device for APP ecosystem | |
| CN113114968A (en) | Video processing method, device, equipment and storage medium | |
| CN116458196A (en) | Analysis-based business classification rules | |
| CN111787167A (en) | Speech recognition marking classification method based on artificial intelligence technology | |
| CN112350986B (en) | Shaping method and system for audio and video network transmission fragmentation | |
| CN112187851A (en) | Multi-screen information pushing method and device based on 5G and edge calculation | |
| CN108833724B (en) | CDR synthesis method and device | |
| CN114580734A (en) | Big data combined digital social network information optimization method and server |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |