CN108600208A - A kind of fine granularity flow arbitration device and method for server cluster - Google Patents

A kind of fine granularity flow arbitration device and method for server cluster Download PDF

Info

Publication number
CN108600208A
CN108600208A CN201810326569.5A CN201810326569A CN108600208A CN 108600208 A CN108600208 A CN 108600208A CN 201810326569 A CN201810326569 A CN 201810326569A CN 108600208 A CN108600208 A CN 108600208A
Authority
CN
China
Prior art keywords
flow
traffic scheduler
message
producer
consumer
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810326569.5A
Other languages
Chinese (zh)
Inventor
吴伟雄
于姝
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nanjing Sinovatio Technology LLC
Original Assignee
Nanjing Sinovatio Technology LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanjing Sinovatio Technology LLC filed Critical Nanjing Sinovatio Technology LLC
Priority to CN201810326569.5A priority Critical patent/CN108600208A/en
Publication of CN108600208A publication Critical patent/CN108600208A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00Network architectures or network communication protocols for network security
    • H04L63/14Network architectures or network communication protocols for network security for detecting or protecting against malicious traffic
    • H04L63/1408Network architectures or network communication protocols for network security for detecting or protecting against malicious traffic by monitoring network traffic
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L47/00Traffic control in data switching networks
    • H04L47/10Flow control; Congestion control
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L47/00Traffic control in data switching networks
    • H04L47/10Flow control; Congestion control
    • H04L47/12Avoiding congestion; Recovering from congestion
    • H04L47/125Avoiding congestion; Recovering from congestion by balancing the load, e.g. traffic engineering

Abstract

The present invention provides a kind of fine granularity flow arbitration device and method for server cluster, it is provided with traffic scheduler, the flow producer, flow consumer, make the flow producer correspond on one side the information for receiving flow consumer and according to information while by traffic scheduler to shunt, to realize that server cluster stablizes the purpose of processing business flow, server sky is effectively prevent to run and the abnormal cases such as overload operation.The program can effectively improve the reliability and stability of network information monitoring system, and save power consumption to a certain extent.

Description

A kind of fine granularity flow arbitration device and method for server cluster
Technical field
The present invention relates to network safety fileds, and in particular to a kind of fine granularity flow for server cluster arbitrates dress It sets.
Present invention simultaneously relates to a kind of fine granularity flow referee methods for server cluster.
Background technology
In recent years, with the high speed development of internet so that the real-time network safety problem of mass data is aobvious in backbone network Must be particularly important, this just puts forward higher requirements the management of network secondary server cluster.These servers under normal conditions The monitoring and analysis to the network information are completed by shunting device, but the processing capacity of these servers is limited, and It is likely to occur various problems at runtime, causes effectively to monitor network implementation.
Therefore need a kind of new technical solution to solve the above problems.
Invention content
It is an object of the invention to:A kind of fine granularity flow arbitration device for server cluster is provided, to solve such as The problem of what makes server cluster stablize processing business flow.
Present invention simultaneously provides the fine granularity flow referee methods for server cluster, same to solve how to make server Cluster stablizes the problem of processing business flow.
In order to achieve the above objectives, following technology can be used for the fine granularity flow arbitration device of server cluster in the present invention Scheme:
A kind of fine granularity flow arbitration device for server cluster, including:
Traffic scheduler, the equipment of shunting device and integrated service device cluster feedback information in order to control,
The flow producer, i.e. shunting device, the flow producer establish control connection with traffic scheduler, and traffic scheduler is logical It crosses the control and connects the strategy for issuing production flow to the flow producer,
Flow consumer, i.e. server cluster, flow consumer are established with traffic scheduler and are communicated to connect, flow consumer Traffic scheduler, which is fed back to, by the communication connection needs the information acquired;After traffic scheduler receives and integrates these information, The traffic distribution strategy of the flow producer is adjusted, the flow that the flow producer is diverted to flow consumer is changed.
Advantageous effect:The present invention can be received the information of flow consumer on one side by traffic scheduler and according to the information It on one side corresponds to the flow producer to shunt, to realize that server cluster stablizes the purpose of processing business flow, effectively prevent Server sky is run and the abnormal cases such as overload operation.The program can effectively improve the network information monitoring system reliability and Stability, and power consumption is saved to a certain extent.
Further, control connection, traffic scheduler and the flow consumer between traffic scheduler and the flow producer Between communication connection be all based on the connections of tcp agreements.
Further, the communication message format during control is connected and communicated to connect is sealed on the basis of standard Ethernet message Made of dress, which individually divides regular length as private network protocol massages head in Ethernet message data field, is somebody's turn to do Heading fills the description of this message, including message length, type of message, message blocks number, and can provide legal report The function of text verification.
A kind of fine granularity flow referee method for server cluster provided by the invention, which is characterized in that including with Lower step:
(1), traffic scheduler, the flow producer, flow consumer are set;The flow producer, that is, shunting device, flow disappear The person of expense i.e. server cluster;
(2), the flow producer and traffic scheduler establish control connection, and traffic scheduler is connected by the control to flow The producer issues the strategy of production flow;Flow consumer is established with traffic scheduler and is communicated to connect, and flow consumer passes through this Communication connection feeds back to traffic scheduler and needs the information acquired;After traffic scheduler receives and integrates these information, stream is adjusted The traffic distribution strategy of the producer is measured, the flow that the flow producer is diverted to flow consumer is changed.
Advantageous effect:The present invention can be received the information of flow consumer on one side by traffic scheduler and according to the information It on one side corresponds to the flow producer to shunt, to realize that server cluster stablizes the purpose of processing business flow, effectively prevent Server sky is run and the abnormal cases such as overload operation.The program can effectively improve the network information monitoring system reliability and Stability, and power consumption is saved to a certain extent.
Description of the drawings
Fig. 1 is the work flow diagram of the fine granularity flow arbitration device of the server cluster of the present invention.
Fig. 2 is the communication message form schematic diagram used in the present invention.
Specific implementation mode
Below in conjunction with the accompanying drawings to illustrating.
Embodiment one
Shown in Fig. 1, embodiment one provides a kind of reality of the fine granularity flow arbitration device for server cluster Apply example, traffic scheduler, the equipment of shunting device and integrated service device cluster feedback information in order to control,
The flow producer, i.e. shunting device, the flow producer establish control connection with traffic scheduler, and traffic scheduler is logical It crosses the control and connects the strategy for issuing production flow to the flow producer,
Flow consumer, i.e. server cluster, flow consumer are established with traffic scheduler and are communicated to connect, flow consumer Traffic scheduler is fed back to by the communication connection and needs the information acquired, and such as the cpu busy percentage of server cluster, memory uses Deng;After traffic scheduler receives and integrates these information, the traffic distribution strategy of the flow producer is adjusted, changes the flow producer It is diverted to the flow of flow consumer.Wherein, the control connection between traffic scheduler and the flow producer, traffic scheduler with Communication connection between flow consumer is all based on the connection of tcp agreements.As shown in Fig. 2, in control connection and communication connection Communication message format is made of being encapsulated on the basis of standard Ethernet message, and the communication message format is in Ethernet message data field Regular length is individually divided as private network protocol massages head, which fills the description of this message, including message length, report Literary type, message blocks number, and the function of legal message checking can be provided.
Embodiment two
The fine granularity flow arbitration device for server cluster of corresponding above-described embodiment one, embodiment two provide one kind For the fine granularity flow referee method of server cluster, include the following steps:
(1), traffic scheduler, the flow producer, flow consumer are set;The flow producer, that is, shunting device, flow disappear The person of expense i.e. server cluster;
(2), the flow producer and traffic scheduler establish control connection, and traffic scheduler is connected by the control to flow The producer issues the strategy of production flow;Flow consumer is established with traffic scheduler and is communicated to connect, and flow consumer passes through this Communication connection feeds back to traffic scheduler and needs the information acquired;After traffic scheduler receives and integrates these information, stream is adjusted The traffic distribution strategy of the producer is measured, the flow that the flow producer is diverted to flow consumer is changed.
Based on the above-mentioned technical proposal, Fig. 1 is can refer to, the fine granularity flow referee method, including:
Step 101, the flow producer according to distributing strategy by flow shunt to each flow consumer;
Step 102, the flow that flow consumer comes to shunting is analyzed and is handled, and timing is anti-to flow scheduling person The health information for presenting itself, such as the cpu busy percentage of server cluster, memory uses;
Step 103, flow scheduling person adjusts the flow producer's according to each flow consumer feedack received Distributing strategy, when the CPU of server cluster, memory usage are higher, flow scheduling person should optimize distributing strategy, reduce shunting To the flow of the server cluster.
The real work flow of entire method is the continuous repetition of above step.

Claims (6)

1. a kind of fine granularity flow arbitration device for server cluster, which is characterized in that including:
Traffic scheduler, the equipment of shunting device and integrated service device cluster feedback information in order to control,
The flow producer, i.e. shunting device, the flow producer establish control connection with traffic scheduler, and traffic scheduler passes through this Control connection issues the strategy of production flow to the flow producer,
Flow consumer, i.e. server cluster, flow consumer are established with traffic scheduler and are communicated to connect, and flow consumer passes through The communication connection feeds back to traffic scheduler and needs the information acquired;After traffic scheduler receives and integrates these information, adjust The traffic distribution strategy of the flow producer changes the flow that the flow producer is diverted to flow consumer.
2. fine granularity flow arbitration device according to claim 1, it is characterised in that:Traffic scheduler and the flow producer Between control connection, the communication connection between traffic scheduler and flow consumer be all based on the connections of tcp agreements.
3. fine granularity flow arbitration device according to claim 1 or 2, it is characterised in that:Control connection and communication connection In communication message format be on the basis of standard Ethernet message encapsulate made of, the communication message format is in Ethernet message number Regular length is individually divided according to area as private network protocol massages head, which fills the description of this message, including message is long Degree, type of message, message blocks number, and the function of legal message checking can be provided.
4. a kind of fine granularity flow referee method for server cluster, which is characterized in that include the following steps:
(1), traffic scheduler, the flow producer, flow consumer are set;The flow producer, that is, shunting device, flow consumer That is server cluster;
(2), the flow producer and traffic scheduler establish control connection, and traffic scheduler is connected by the control and produced to flow Person issues the strategy of production flow;Flow consumer is established with traffic scheduler and is communicated to connect, and flow consumer passes through the communication Connection feeds back to traffic scheduler and needs the information acquired;After traffic scheduler receives and integrates these information, flow life is adjusted The traffic distribution strategy of production person changes the flow that the flow producer is diverted to flow consumer.
5. fine granularity flow referee method according to claim 4, it is characterised in that:Traffic scheduler and the flow producer Between control connection, the communication connection between traffic scheduler and flow consumer be all based on the connections of tcp agreements.
6. fine granularity flow referee method according to claim 4 or 5, it is characterised in that:Control connection and communication connection In communication message format be on the basis of standard Ethernet message encapsulate made of, the communication message format is in Ethernet message number Regular length is individually divided according to area as private network protocol massages head, which fills the description of this message, including message is long Degree, type of message, message blocks number, and the function of legal message checking can be provided.
CN201810326569.5A 2018-04-12 2018-04-12 A kind of fine granularity flow arbitration device and method for server cluster Pending CN108600208A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810326569.5A CN108600208A (en) 2018-04-12 2018-04-12 A kind of fine granularity flow arbitration device and method for server cluster

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810326569.5A CN108600208A (en) 2018-04-12 2018-04-12 A kind of fine granularity flow arbitration device and method for server cluster

Publications (1)

Publication Number Publication Date
CN108600208A true CN108600208A (en) 2018-09-28

Family

ID=63622283

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810326569.5A Pending CN108600208A (en) 2018-04-12 2018-04-12 A kind of fine granularity flow arbitration device and method for server cluster

Country Status (1)

Country Link
CN (1) CN108600208A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109462586A (en) * 2018-11-08 2019-03-12 北京知道创宇信息技术有限公司 Flow monitoring method, device and execute server
CN114124957A (en) * 2021-11-19 2022-03-01 厦门大学 Distributed node interconnection method applied to robot

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102075358A (en) * 2010-12-31 2011-05-25 网宿科技股份有限公司 System and method for distributing and deploying content of large-scale server cluster
CN103973809A (en) * 2014-05-22 2014-08-06 北京锐安科技有限公司 Data distributing method and system
CN105282043A (en) * 2014-06-20 2016-01-27 中国电信股份有限公司 Global network load balancing system, device and method
CN105630589A (en) * 2014-11-24 2016-06-01 航天恒星科技有限公司 Distributed process scheduling system and process scheduling and execution method
EP3128423A1 (en) * 2015-08-06 2017-02-08 Hewlett-Packard Enterprise Development LP Distributed event processing
CN107566484A (en) * 2017-08-31 2018-01-09 深信服科技股份有限公司 A kind of traffic scheduling method and device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102075358A (en) * 2010-12-31 2011-05-25 网宿科技股份有限公司 System and method for distributing and deploying content of large-scale server cluster
CN103973809A (en) * 2014-05-22 2014-08-06 北京锐安科技有限公司 Data distributing method and system
CN105282043A (en) * 2014-06-20 2016-01-27 中国电信股份有限公司 Global network load balancing system, device and method
CN105630589A (en) * 2014-11-24 2016-06-01 航天恒星科技有限公司 Distributed process scheduling system and process scheduling and execution method
EP3128423A1 (en) * 2015-08-06 2017-02-08 Hewlett-Packard Enterprise Development LP Distributed event processing
CN107566484A (en) * 2017-08-31 2018-01-09 深信服科技股份有限公司 A kind of traffic scheduling method and device

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109462586A (en) * 2018-11-08 2019-03-12 北京知道创宇信息技术有限公司 Flow monitoring method, device and execute server
CN114124957A (en) * 2021-11-19 2022-03-01 厦门大学 Distributed node interconnection method applied to robot
CN114124957B (en) * 2021-11-19 2022-12-06 厦门大学 Distributed node interconnection method applied to robot

Similar Documents

Publication Publication Date Title
CN106850188B (en) A kind of data transmission system based on multichannel isomery one-way transmission path
CN101989926B (en) System and method for adjusting an energy efficient ethernet
US20150121100A1 (en) Method For Acting as Service Agent, Modem, and Terminal
CN101454741A (en) Method and apparatus to dynamically adjust resource power usage in a distributed system
CN108600208A (en) A kind of fine granularity flow arbitration device and method for server cluster
HUE028442T2 (en) Parameter configuration method, base station, and user equipment
US9244805B2 (en) Method for generating descriptive trace gaps
CN106330643A (en) Communication method of one-host and multi-slave communication network and communication device
CN107196816A (en) Anomalous traffic detection method, system and Network analyzing equipment
CN111970195A (en) Data transmission method and streaming data transmission system
CN106817314A (en) Big data acquisition method, device and system
CN109445325A (en) A kind of high speed ARINC429 data processing method based on FPGA
CN102368729B (en) Accurate network speed limit method at non-realtime system
CN103634223A (en) Network service flow based dynamic control transmission method and device
WO2014015665A1 (en) Data processing method, device, and system
CN101170509A (en) Traffic control method for switching router system
CN103685363A (en) Efficient and reliable method and system for multitask processing
CN109474364A (en) The network timing synchronization systems being mutually isolated
US9304890B2 (en) Method for throttling trace data streams
CN107734391A (en) The implementation method of intelligent television application upgrade
CN106789743A (en) The adaptive bandwidth adjusting method and device of a kind of SDN data transmission sets
CN107248961A (en) A kind of management method and management system of Internet of Things data flow
CN102355376B (en) Traffic monitoring method and device
CN104767641A (en) Flow adjusting method, device and system
CN104135447B (en) The transmission method and device of a kind of packet

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20180928

RJ01 Rejection of invention patent application after publication