CN105262697A - Network traffic shunting method and system - Google Patents
Network traffic shunting method and system Download PDFInfo
- Publication number
- CN105262697A CN105262697A CN201510824356.1A CN201510824356A CN105262697A CN 105262697 A CN105262697 A CN 105262697A CN 201510824356 A CN201510824356 A CN 201510824356A CN 105262697 A CN105262697 A CN 105262697A
- Authority
- CN
- China
- Prior art keywords
- network packet
- network
- tuple data
- packet
- flow quantity
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
Abstract
The invention discloses a network traffic shunting method and a system. Acquired network data packets form a traffic trace file, and an arrival time for each network data packet and corresponding quintuple data are obtained; each network data packet is matched according to the corresponding quintuple data, and as for a target network data packet with the same quintuple data, a time interval between the target network data packet and a target corresponding network data packet with the same quintuple data is calculated; and whether the time interval is smaller than or equal to a preset time threshold, if yes, the target network data packet and the target corresponding network data packet are merged according to an arrival time sequence to form a streaming file, if not, the target network data packet and the target corresponding network data packet are merged respectively to different streaming files, whether the network data packets are shunted is decided by whether the quintuple data are consistent and whether the time interval is in the threshold, and network traffic shunting can be carried out high efficiently.
Description
Technical field
The present invention relates to network traffics planning field, particularly relate to a kind of network flow quantity shunting method and system.
Background technology
Current network traffics and network link speed constantly rise, and the planning of network traffics seems particularly important, in the network planning based on stream network research be current popular technology, first this technology needs to carry out network flow quantity shunting.
Network flow quantity shunting to as if network traffics trace file, and network traffics trace file belongs to the data-intensive data of magnanimity.Current network flow quantity shunting has become the performance bottleneck that high-speed network flow is analyzed.
Summary of the invention
In view of this, main purpose of the present invention is to provide a kind of network flow quantity shunting method and system, can carry out network flow quantity shunting efficiently.
For achieving the above object, the invention provides a kind of network flow quantity shunting method, comprising:
The network packet obtained is formed flow trace file;
Each described network packet in described trace file is analyzed, obtains the five-tuple data of each described network packet time of advent and correspondence;
The five-tuple data of each described network packet according to correspondence are mated, to the objective network packet that five-tuple data can be found identical, calculate objective network packet described in this and the time interval between the target map network packet identical with its five-tuple data;
Judge whether the described time interval is less than or equal to preset time threshold, if it is by described objective network packet and described target map network packet according to the order merger time of advent, form a stream file, otherwise by described objective network packet and the described target map network packet stream file that merger is extremely different respectively.
Preferably, described five-tuple data comprise:
Source IP address, source port, object IP address, destination interface and transport layer protocol.
Preferably, described preset time threshold is 50s ~ 70s.
Preferably, described flow trace file is txt form.
Present invention also offers a kind of network flow quantity shunting system, comprising:
Flow trace file acquisition module, the network packet for obtaining forms flow trace file;
Network data packet analysis module, for analyzing each described network packet in described trace file, obtains the five-tuple data of each described network packet time of advent and correspondence;
Matching module, for mating the five-tuple data of each described network packet according to correspondence, to the objective network packet that five-tuple data can be found identical, calculate objective network packet described in this and the time interval between the target map network packet identical with its five-tuple data;
Diverter module, for judging whether the described time interval is less than or equal to preset time threshold, if it is by described objective network packet and described target map network packet according to the order merger time of advent, form a stream file, otherwise by described objective network packet and the described target map network packet stream file that merger is extremely different respectively.
Preferably, described five-tuple data comprise:
Source IP address, source port, object IP address, destination interface and transport layer protocol.
Preferably, described preset time threshold is 50s ~ 70s.
Preferably, described flow trace file is txt form.
Apply a kind of network flow quantity shunting method provided by the invention and system, the network packet obtained is formed flow trace file; Each described network packet in described trace file is analyzed, obtains the five-tuple data of each described network packet time of advent and correspondence; The five-tuple data of each described network packet according to correspondence are mated, to the objective network packet that five-tuple data can be found identical, calculate objective network packet described in this and the time interval between the target map network packet identical with its five-tuple data; Judge whether the described time interval is less than or equal to preset time threshold, if it is by described objective network packet and described target map network packet according to the order merger time of advent, form a stream file, otherwise by described objective network packet and the described target map network packet stream file that merger is extremely different respectively, according to five-tuple data, whether consistent the and time interval determines whether network packet shunted, can carry out the shunting of network traffics efficiently in threshold value.
Accompanying drawing explanation
In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, be briefly described to the accompanying drawing used required in embodiment or description of the prior art below, apparently, accompanying drawing in the following describes is only embodiments of the invention, for those of ordinary skill in the art, under the prerequisite not paying creative work, other accompanying drawing can also be obtained according to the accompanying drawing provided.
Fig. 1 is the flow chart of a kind of network flow quantity shunting method embodiment of the present invention;
Fig. 2 is the structural representation of a kind of network flow quantity shunting system embodiment of the present invention.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, be clearly and completely described the technical scheme in the embodiment of the present invention, obviously, described embodiment is only the present invention's part embodiment, instead of whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art, not making the every other embodiment obtained under creative work prerequisite, belong to the scope of protection of the invention.
The invention provides a kind of network flow quantity shunting method, Fig. 1 shows the flow chart of network flow quantity shunting method embodiment of the present invention, comprising:
Step S101: the network packet obtained is formed flow trace file;
Described flow trace file is .txt form.
Step S102: analyze each described network packet in described trace file, obtains the five-tuple data of each described network packet time of advent and correspondence;
Five-tuple data comprise: source IP address, source port, object IP address, destination interface and transport layer protocol.
Step S103: the five-tuple data of each described network packet according to correspondence are mated, to the objective network packet that five-tuple data can be found identical, calculate objective network packet described in this and the time interval between the target map network packet identical with its five-tuple data;
The packets need with identical five-tuple is calculated to the time interval T of current data packet and a upper packet.
Step S104: judge whether the described time interval is less than or equal to preset time threshold, if yes then enter step S105, otherwise enter step S106;
If preset time threshold is 60s, reality can be arranged as required.
Step S105: by described objective network packet and described target map network packet according to the order merger time of advent, form a stream file;
If T<=60s, then packet is carried out merger according to the time of advent of order successively, form a stream file.
Step S105: by described objective network packet and the described target map network packet stream file that merger is extremely different respectively.
If T>60s, so packet is integrated in different stream files, shunts.
User can be submitted to by browser needs the trace file of shunting to system platform, shunting division of tasks is become the individual little task unit of n after receiving task by host node, computing node will send a heartbeat to host node termly at set intervals, after tell the current computing node of host node whether to be in heartbeat that idle condition host node receives computing node and state information, also timing is wanted to submit the state of current computing node to task scheduling node, task scheduling querying node node free list, then the little unit of appointing of segmentation is sent to the computing node of idle condition, after computing node receives the task of TU task unit transmission, from data memory node, data are obtained according to the positional information of data block in TU task unit, carry out corresponding calculating operation, this operation is local execution.The pressure that local execution can reduce the network bandwidth, decreases the time consumption writing intermediate file simultaneously; After computing node executes task, result is returned to task scheduling node and gather, final result is submitted to user by task scheduling node.
A kind of network flow quantity shunting method that application the present embodiment provides, forms flow trace file by the network packet obtained; Each described network packet in described trace file is analyzed, obtains the five-tuple data of each described network packet time of advent and correspondence; The five-tuple data of each described network packet according to correspondence are mated, to the objective network packet that five-tuple data can be found identical, calculate objective network packet described in this and the time interval between the target map network packet identical with its five-tuple data; Judge whether the described time interval is less than or equal to preset time threshold, if it is by described objective network packet and described target map network packet according to the order merger time of advent, form a stream file, otherwise by described objective network packet and the described target map network packet stream file that merger is extremely different respectively, according to five-tuple data, whether consistent the and time interval determines whether network packet shunted, can carry out the shunting of network traffics efficiently in threshold value.
Present invention also offers a kind of network flow quantity shunting system, Fig. 2 shows the structural representation of network flow quantity shunting system embodiment of the present invention, comprising:
Flow trace file acquisition module 101, the network packet for obtaining forms flow trace file;
Network data packet analysis module 102, is connected with described flow trace file acquisition module 101, for analyzing each described network packet in described trace file, obtains the five-tuple data of each described network packet time of advent and correspondence;
Matching module 103, be connected with described network data packet analysis module 102, for mating the five-tuple data of each described network packet according to correspondence, to the objective network packet that five-tuple data can be found identical, calculate objective network packet described in this and the time interval between the target map network packet identical with its five-tuple data;
Diverter module 104, be connected with described matching module 103, for judging whether the described time interval is less than or equal to preset time threshold, if it is by described objective network packet and described target map network packet according to the order merger time of advent, form a stream file, otherwise by described objective network packet and the described target map network packet stream file that merger is extremely different respectively.
In the present embodiment, described five-tuple data comprise: source IP address, source port, object IP address, destination interface and transport layer protocol, and described preset time threshold is 50s ~ 70s, and described flow trace file is txt form.
A kind of network flow quantity shunting system that application the present embodiment provides, forms flow trace file by the network packet obtained; Each described network packet in described trace file is analyzed, obtains the five-tuple data of each described network packet time of advent and correspondence; The five-tuple data of each described network packet according to correspondence are mated, to the objective network packet that five-tuple data can be found identical, calculate objective network packet described in this and the time interval between the target map network packet identical with its five-tuple data; Judge whether the described time interval is less than or equal to preset time threshold, if it is by described objective network packet and described target map network packet according to the order merger time of advent, form a stream file, otherwise by described objective network packet and the described target map network packet stream file that merger is extremely different respectively, according to five-tuple data, whether consistent the and time interval determines whether network packet shunted, can carry out the shunting of network traffics efficiently in threshold value.
It should be noted that, each embodiment in this specification all adopts the mode of going forward one by one to describe, and what each embodiment stressed is the difference with other embodiments, between each embodiment identical similar part mutually see.For system class embodiment, due to itself and embodiment of the method basic simlarity, so description is fairly simple, relevant part illustrates see the part of embodiment of the method.
Finally, also it should be noted that, in this article, term " comprises ", " comprising " or its any other variant are intended to contain comprising of nonexcludability, thus make to comprise the process of a series of key element, method, article or equipment and not only comprise those key elements, but also comprise other key elements clearly do not listed, or also comprise by the intrinsic key element of this process, method, article or equipment.When not more restrictions, the key element limited by statement " comprising ... ", and be not precluded within process, method, article or the equipment comprising described key element and also there is other identical element.
Be described in detail method and system provided by the present invention above, apply specific case herein and set forth principle of the present invention and execution mode, the explanation of above embodiment just understands method of the present invention and core concept thereof for helping; Meanwhile, for one of ordinary skill in the art, according to thought of the present invention, all will change in specific embodiments and applications, in sum, this description should not be construed as limitation of the present invention.
Claims (8)
1. a network flow quantity shunting method, is characterized in that, comprising:
The network packet obtained is formed flow trace file;
Each described network packet in described trace file is analyzed, obtains the five-tuple data of each described network packet time of advent and correspondence;
The five-tuple data of each described network packet according to correspondence are mated, to the objective network packet that five-tuple data can be found identical, calculate objective network packet described in this and the time interval between the target map network packet identical with its five-tuple data;
Judge whether the described time interval is less than or equal to preset time threshold, if it is by described objective network packet and described target map network packet according to the order merger time of advent, form a stream file, otherwise by described objective network packet and the described target map network packet stream file that merger is extremely different respectively.
2. network flow quantity shunting method according to claim 1, is characterized in that, described five-tuple data comprise:
Source IP address, source port, object IP address, destination interface and transport layer protocol.
3. network flow quantity shunting method according to claim 1, is characterized in that, described preset time threshold is 50s ~ 70s.
4. network flow quantity shunting method according to claim 1, is characterized in that, described flow trace file is txt form.
5. a network flow quantity shunting system, is characterized in that, comprising:
Flow trace file acquisition module, the network packet for obtaining forms flow trace file;
Network data packet analysis module, for analyzing each described network packet in described trace file, obtains the five-tuple data of each described network packet time of advent and correspondence;
Matching module, for mating the five-tuple data of each described network packet according to correspondence, to the objective network packet that five-tuple data can be found identical, calculate objective network packet described in this and the time interval between the target map network packet identical with its five-tuple data;
Diverter module, for judging whether the described time interval is less than or equal to preset time threshold, if it is by described objective network packet and described target map network packet according to the order merger time of advent, form a stream file, otherwise by described objective network packet and the described target map network packet stream file that merger is extremely different respectively.
6. network flow quantity shunting system according to claim 5, is characterized in that, described five-tuple data comprise:
Source IP address, source port, object IP address, destination interface and transport layer protocol.
7. network flow quantity shunting system according to claim 5, is characterized in that, described preset time threshold is 50s ~ 70s.
8. network flow quantity shunting system according to claim 5, is characterized in that, described flow trace file is txt form.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510824356.1A CN105262697A (en) | 2015-11-24 | 2015-11-24 | Network traffic shunting method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510824356.1A CN105262697A (en) | 2015-11-24 | 2015-11-24 | Network traffic shunting method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105262697A true CN105262697A (en) | 2016-01-20 |
Family
ID=55102205
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510824356.1A Pending CN105262697A (en) | 2015-11-24 | 2015-11-24 | Network traffic shunting method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105262697A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106603431A (en) * | 2016-12-15 | 2017-04-26 | 中国科学院沈阳自动化研究所 | Industrial wireless network data scheduling method and apparatus based on the mixture of key tasks |
| CN108632156A (en) * | 2017-03-24 | 2018-10-09 | 英特尔公司 | Load balance system, device and method |
| CN110072245A (en) * | 2019-03-22 | 2019-07-30 | 华为技术有限公司 | A kind of data transmission method and device |
| CN110868360A (en) * | 2019-11-19 | 2020-03-06 | 深圳市网心科技有限公司 | Flow statistical method, electronic device, system and medium |
| CN113568868A (en) * | 2021-07-28 | 2021-10-29 | 重庆紫光华山智安科技有限公司 | File system management method, system, electronic device and medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101051952A (en) * | 2007-04-18 | 2007-10-10 | 东南大学 | Self adaption sampling stream measuring method under high speed multilink logic channel environment |
| CN103036984A (en) * | 2012-12-17 | 2013-04-10 | 华为技术有限公司 | One-way flow detection method and network equipment |
| CN104333483A (en) * | 2014-10-24 | 2015-02-04 | 深圳市傲天通信有限公司 | Identification method, system and identification device for internet application flow |
| CN104348808A (en) * | 2013-08-02 | 2015-02-11 | 深圳市腾讯计算机系统有限公司 | Session processing method and device |
-
2015
- 2015-11-24 CN CN201510824356.1A patent/CN105262697A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101051952A (en) * | 2007-04-18 | 2007-10-10 | 东南大学 | Self adaption sampling stream measuring method under high speed multilink logic channel environment |
| CN103036984A (en) * | 2012-12-17 | 2013-04-10 | 华为技术有限公司 | One-way flow detection method and network equipment |
| CN104348808A (en) * | 2013-08-02 | 2015-02-11 | 深圳市腾讯计算机系统有限公司 | Session processing method and device |
| CN104333483A (en) * | 2014-10-24 | 2015-02-04 | 深圳市傲天通信有限公司 | Identification method, system and identification device for internet application flow |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106603431A (en) * | 2016-12-15 | 2017-04-26 | 中国科学院沈阳自动化研究所 | Industrial wireless network data scheduling method and apparatus based on the mixture of key tasks |
| CN106603431B (en) * | 2016-12-15 | 2020-09-04 | 中国科学院沈阳自动化研究所 | Industrial wireless network data scheduling method and device based on mixed key tasks |
| CN108632156A (en) * | 2017-03-24 | 2018-10-09 | 英特尔公司 | Load balance system, device and method |
| CN110072245A (en) * | 2019-03-22 | 2019-07-30 | 华为技术有限公司 | A kind of data transmission method and device |
| CN110868360A (en) * | 2019-11-19 | 2020-03-06 | 深圳市网心科技有限公司 | Flow statistical method, electronic device, system and medium |
| CN110868360B (en) * | 2019-11-19 | 2023-04-28 | 深圳市网心科技有限公司 | Flow statistics method, electronic equipment, system and medium |
| CN113568868A (en) * | 2021-07-28 | 2021-10-29 | 重庆紫光华山智安科技有限公司 | File system management method, system, electronic device and medium |
| CN113568868B (en) * | 2021-07-28 | 2024-02-06 | 重庆紫光华山智安科技有限公司 | File system management method, system, electronic equipment and medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105262697A (en) | Network traffic shunting method and system | |
| CN103346922B (en) | The controller of determination network state based on SDN and determine method | |
| CN106664261B (en) | A kind of methods, devices and systems configuring flow entry | |
| JP2017507572A5 (en) | ||
| EP3238392A1 (en) | Technologies for medium grained adaptive routing in high-performance network fabrics | |
| Lin et al. | The roles of 5G mobile broadband in the development of IoT, big data, cloud and SDN | |
| GB2567570A (en) | Detecting and predicting bottlenecks in complex systems | |
| CN104486167A (en) | Concurrence network performance and network trending direction testing method based on MESH network | |
| CN108259364A (en) | A kind of network congestion determines method and device | |
| CN104734905A (en) | Data flow detection method and device | |
| CN102420797A (en) | Topology mapping method and system | |
| CN103078754A (en) | Network data stream statistical method on basis of counting bloom filter | |
| US20140092900A1 (en) | Methods and apparatuses to split incoming data into sub-channels to allow parallel processing | |
| CN102801586A (en) | Method and device for automatically testing quality of service (QoS) granularity and precision | |
| CN104125106A (en) | Network purity detection device and method based on classified decision tree | |
| CN105207905A (en) | Route selection method and device | |
| CN114884893B (en) | Forwarding and control definable cooperative traffic scheduling method and system | |
| CN109150707B (en) | Routing path analysis method and device | |
| CN112822233B (en) | Traffic redirection method and device | |
| CN106533756B (en) | A kind of communication feature extracts, flow generation method and device | |
| Liu et al. | A tighter recursive calculus to compute the worst case traversal time of real-time traffic over NoCs | |
| CN105992280A (en) | Method and device for data processing | |
| CN105488289B (en) | The method of Dynamic Graph structure matching under distributed environment | |
| CN105207951A (en) | Wide area network flow optimization control method and apparatus | |
| US11757742B2 (en) | System and method to distribute traffic flows among a plurality of applications in a data center system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160120 |