CN103067474A - Processing method and device for communication in distributed file system - Google Patents
Processing method and device for communication in distributed file system Download PDFInfo
- Publication number
- CN103067474A CN103067474A CN201210564509XA CN201210564509A CN103067474A CN 103067474 A CN103067474 A CN 103067474A CN 201210564509X A CN201210564509X A CN 201210564509XA CN 201210564509 A CN201210564509 A CN 201210564509A CN 103067474 A CN103067474 A CN 103067474A
- Authority
- CN
- China
- Prior art keywords
- connection
- message
- recipient
- initiator
- formation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention discloses a processing method and a device for communication in a distributed file system. The processing method comprises that connection from an initiator is received by a receiver; classification for the received connection is achieved by the receiver according to a preset classification method; for the connection of each type after classification, the receiver puts the connection of the same type into a received connection queue corresponding to the connection in the same type; and the receiver obtains connection from the received connection queue, information is extracted through the received connection, and processing for the extracted information is achieved. According to the processing method and the device, the classification for the connection which is received from the initiator according to the preset classification method through the receiver is carried out, for the connection of each type after classification, the receiver puts the connection of the same type into a received connection queue corresponding to the connection in the same type, the receiver extracts the information from the connection received by the connection queue and processes, and therefore transmission efficiency of communication load in the distributed file system can be improved and balanced.
Description
Technical field
The present invention relates to computer realm, particularly, relate to processing method and the device of communicating by letter in a kind of distributed file system.
Background technology
Communication system has great importance as the communication infrastructure between each node of system in the distributed file system.Because distributed file system can only realize internodal control command and transfer of data by communication system, therefore, the communication performance between the node has directly determined the overall performance of distributed file system.
The traffic operation of distributed file system is divided into communication initiator and communication receiver, and the operation of communication initiator's initiating communication sends to the communication receiver by network.Communication receiver's receipt message is submitted to the user with the relevant information of message (such as source address information etc.) and message content and is processed, and waits for that the message of finishing dealing with the user rear transmission processing finishing to the communication initiator, finishes communication process one time.In traditional distributed file system realized, in a single day the communication initiator existed communication request, communication request is transferred to communication system carry out information receiving and transmitting, and the communication receiver processes all communication request of coming automatic network, receive data, and submit to the user and process.
And for distributed file system, generally be divided into two parts: client and service node.Client is sent service request to service node in the mode of communication information, the request of service node internal coordination completion service, and return to client.If the traffic load of distributed file system scheduling is uneven, will cause client can not take full advantage of the service ability of service node, cause the hydraulic performance decline of overall distribution formula file system.
In order to solve the problem of communication system load balancing, there is following several method in existing system:
Existing SiteServer LBS refers to client when needs are managed business, according to the loading condition of the server that monitors, selects to send service request to the lighter server of load, and by the request of server completion service, and to the client return results.This SiteServer LBS can be balanced with the load distribution of client to a plurality of different server ends, thereby make the load balancing of server.
In the realization of communication system, for the performance of many networks of taking full advantage of distributed file system, when sending message, according to the load of network, in the middle of link corresponding to a plurality of network interface cards, select a lightest link of load, carry out data and send.This mode can take full advantage of the communication bandwidth of multilink, improves the integrated communication ability of system.
For the communication in the distributed file system, need to satisfy following demand:
On the one hand, the priority of distributed file system message transfer is different with the response time demand, and wherein, it is high having priority, needs the message of real-time response, such as system control message; Also there is the lower message of priority, in full reportedly transmitting messages, statistics, monitoring message etc.Dissimilar message is different to the demand of network, needs the priority scheduling of network based message, guarantees the service quality (Quality of Service is called for short QoS) of message level.Traditional QoS guarantees general in the realization of the communication information unit of hardware-level rank, and other is less to consider the communication information request level.
On the other hand, point-to-point communication is not considered whole system mode, may cause the unjustness of communicating by letter, and causes traffic congestion.For example: N node sends message to a node simultaneously, wherein the data volume of some nodes is large, if do not communicate load dispatch or dispatching method existing problems, will be so that the recipient frequently processes this node request, and can't process the request of other nodes, the problems such as fairness and hol blocking appear.
For existing SiteServer LBS, can't solve the demand: (1) is when client is very many, each server need to be served a large amount of client-requested, when the request time of some clients wherein was long, the situation of certain server load imbalance still can appear; (2) this load-balancing method is only applicable to the node that there are a plurality of same role in server end, and does not consider the traffic load equalization problem between the server inside.Simultaneously the method can only be take node as unit, and the request of client is assigned to different nodes, does not consider to have many cover Network Load Balance problems in the distributed system.
Equally, network multilink selection algorithm can solve the problem of initiator's link selection, takes full advantage of the network bandwidth.But owing to only carry out message control at transmitting terminal, can not the assurance system in traffic load can balanced being distributed on the different nodes.
The problem that efficient for distributed file system transmission of messages and processing in the correlation technique is low, the processing procedure load equilibrium is poor not yet proposes effective solution at present.
Summary of the invention
The problem that efficient for distributed file system transmission of messages and processing in the correlation technique is low, the processing procedure load equilibrium is poor, the present invention proposes processing method and the device of communicating by letter in a kind of distributed file system, can improve the efficient of transmission, and can realize load balancing to reception and the processing of message.
Technical scheme of the present invention is achieved in that
According to an aspect of the present invention, provide the processing method of communicating by letter in a kind of distributed file system, the traffic operation in this distributed file system comprises initiator and the recipient of communication, and this processing method comprises:
The recipient receives the connection from the initiator;
The recipient classifies to the connection that receives according to the sorting technique that sets in advance;
For the connection of sorted each classification, the recipient puts into the reception corresponding with this classification with such other connection and connects formation;
The recipient obtains connection from receive connecting formation, the message of from the connection of obtaining, extracting, and the message of extracting processed.
Wherein, this processing method further comprises:
Set up in advance a plurality of virtual roads that connect between initiator and recipient, and each virtual road that connects is arranged priority, wherein, a plurality of virtual even roads are corresponding one by one with connection.
And this processing method further comprises:
Initiator and recipient carry out the flow control counting in this locality separately, the recipient adjusts the speed of initiator's transmission message according to the result of flow control counting.
And, the recipient receive and untreated size of message in the information receiving and transmitting total amount in the shared situation of ratio greater than the first proportion threshold value, the recipient notifies transmit leg to reduce the speed that sends message;
The recipient receive and untreated size of message in the information receiving and transmitting total amount in the shared situation of ratio less than the second proportion threshold value, the recipient notifies transmit leg to increase the speed that sends message, the first proportion threshold value is greater than the second proportion threshold value;
Wherein, the information receiving and transmitting total amount equals initiator's flow control counting and recipient's flow control counting sum, and, connecting in the situation that sends a piece of news by sending the initiator, initiator's flow control counting reduces by a step-length; The recipient by the situation that receives a piece of news under, recipient's flow control counting increases a step-length; Process the recipient in the situation of a piece of news, initiator's flow control counting increases by a step-length, and recipient's flow control counting reduces a step-length.
In addition, the recipient according to the sorting technique that sets in advance to the connection that receives classify comprise following one of at least:
Classify in address according to the initiator;
Classify according to receiving the priority that connects formation;
The quantity that receives message according to reception connection formation is classified.
And the recipient obtains to connect from reception connection formation and comprises:
The recipient obtains connection according to pre-configured dispatching method from receiving the connection formation.
And, pre-configured dispatching method comprise following one of arbitrarily:
Mode with circulation is obtained connection from each reception connection formation;
To connecting the priority orders that arranges, obtain connection with this from receiving the connection formation according in advance;
According to the message number of each connection, receive the connection formation from each and obtain connection.
Wherein, after the message of extracting from the connection of obtaining, processing method also comprises:
This connection is deleted from the reception connection formation at place.
In addition, after the message of extracting from the connection of obtaining, processing method further comprises:
This connection is reconfigured to distributed file system.
According to another aspect of the present invention, provide the processing unit of communicating by letter in a kind of distributed file system, the traffic operation in this distributed file system comprises initiator and the recipient of communication, it is characterized in that processing unit comprises:
Receiver module is used for receiving the connection from the initiator;
Sort module is used for according to the sorting technique that sets in advance the connection that receives being classified;
Configuration module is used for the connection for sorted each classification, the reception corresponding with this classification is put in such other connection connect formation;
Processing module is used for connecting formation and obtaining connection from receiving, the message of from the connection of obtaining, extracting, and the message of extracting processed.
The present invention classifies to the connection from the initiator that receives according to the sorting technique that sets in advance by the recipient, corresponding connection formation is put in the connection of sorted each classification, and extract message and finish processing according to formation, can Effective Raise the efficient of transmission, and can and process the equilibrium that realizes load to the reception of message.
Description of drawings
In order to be illustrated more clearly in the embodiment of the invention or technical scheme of the prior art, the below will do to introduce simply to the accompanying drawing of required use among the embodiment, apparently, accompanying drawing in the following describes only is some embodiments of the present invention, for those of ordinary skills, under the prerequisite of not paying creative work, can also obtain according to these accompanying drawings other accompanying drawing.
Fig. 1 is the flow chart of the processing method of communicating by letter in the distributed file system according to the embodiment of the invention;
Fig. 2 is the flow chart of setting up virtual link in the processing method of communicating by letter in the distributed file system according to the embodiment of the invention;
Fig. 3 is the flow chart of the active flow control feedback system in the processing method of communicating by letter in the distributed file system according to the embodiment of the invention;
Fig. 4 is the flow chart that the recipient in the processing method of communicating by letter in the distributed file system according to the embodiment of the invention connects scheduling mode;
Fig. 5 is the block diagram of the processing unit of communicating by letter in the distributed file system according to the embodiment of the invention.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the invention, the technical scheme in the embodiment of the invention is clearly and completely described, obviously, described embodiment only is the present invention's part embodiment, rather than whole embodiment.Based on the embodiment among the present invention, the every other embodiment that those of ordinary skills obtain belongs to the scope of protection of the invention.
According to one embodiment of present invention, provide the processing method of communicating by letter in a kind of distributed file system, the traffic operation in this distributed file system comprises initiator and the recipient of communication.
The processing method of communicating by letter in the distributed file system according to the embodiment of the invention as shown in Figure 1, comprises:
Step S101, the recipient receives the connection from the initiator;
Step S103, the recipient classifies to the connection that receives according to the sorting technique that sets in advance;
Step S105, for the connection of sorted each classification, the recipient puts into the reception corresponding with this classification with such other connection and connects formation;
Step S107, the recipient obtains connection from receive connecting formation, the message of from the connection of obtaining, extracting, and the message of extracting processed.
Wherein, this processing method further comprises:
Set up in advance a plurality of virtual roads that connect between initiator and recipient, and each virtual road that connects is arranged priority, wherein, a plurality of virtual even roads are corresponding one by one with connection.
As shown in Figure 2, for setting up the flow chart of virtual link in the processing method of communicating by letter in the distributed file system according to the embodiment of the invention.Before communications began, application layer initiator sent to message first the communication layers initiator, and after communications was finished, communication layers recipient sent to message the application layer recipient again.And between point-to-point (initiator is to the recipient), set up the passage of many virtual transmission, dissimilar message maps is transmitted to different virtual company roads, simultaneously the recipient, connect communication request on the road according to the high reduction process different virtual of priority, concrete grammar is:
Step S1, when between point-to-point (initiator is to the recipient), connecting, configuration according to virtual link, between a pair of point (initiator and recipient), set up the virtual road that connects of a plurality of different priorities, there is a virtual road VL of company in each virtual road that connects, is that numbering VL1 is to numbering VL5 among Fig. 2.
Step S2, initiator, calculate and send the virtual road VL of company corresponding to message, and carry out corresponding message transmission according to mapping ruler according to the priority that sends message.
Step S3, recipient according to the virtual priority height that connects road receipt message step by step, at first receive the high virtual message that connects on the road of priority, and then receive the message in the low connection of priority when receiving the virtual message sink request that connects the road.The virtual message that connects on the road that has so just guaranteed high priority is preferentially processed.
Among Fig. 2, the virtual priority ordering from high to low that connects the road is: VL1, VL2, VL3, VL4, VL5, therefore, the recipient at first receives the message on the VL1, and next receives the message on the VL2, and the 3rd receives the message on the VL3, the 4th receives the message on the VL4, receives at last the message on the VL5.
And this processing method further comprises:
Initiator and recipient carry out the flow control counting in this locality separately, the recipient adjusts the speed of initiator's transmission message according to the result of flow control counting.
And, the recipient receive and untreated size of message shared ratio is greater than the first proportion threshold value in the information receiving and transmitting total amount, then the recipient notifies transmit leg to reduce the speed that sends message;
The recipient receive and untreated size of message shared ratio is less than the second proportion threshold value in the information receiving and transmitting total amount, then the recipient notifies transmit leg to increase the speed that sends message;
Wherein, the information receiving and transmitting total amount equals initiator's flow control counting and recipient's flow control counting sum, and, connecting in the situation that sends a piece of news by sending the initiator, initiator's flow control counting reduces by a step-length; The recipient by the situation that receives a piece of news under, recipient's flow control counting increases a step-length; Process the recipient in the situation of a piece of news, initiator's flow control counting increases by a step-length, and recipient's flow control counting reduces a step-length.
In addition, the recipient according to the sorting technique that sets in advance to the connection that receives classify comprise following one of at least:
Classify in address according to the initiator;
Classify according to receiving the priority that connects formation;
The quantity that receives message according to reception connection formation is classified.
And the recipient obtains to connect from reception connection formation and comprises:
The recipient obtains connection according to pre-configured dispatching method from receiving the connection formation.
And, pre-configured dispatching method comprise following one of arbitrarily:
Mode with circulation is obtained connection from each reception connection formation;
To connecting the priority orders that arranges, obtain connection with this from receiving the connection formation according in advance;
According to the message number of each connection, receive the connection formation from each and obtain connection.
Wherein, after the message of extracting from the connection of obtaining, processing method also comprises:
This connection is deleted from the reception connection formation at place.
In addition, after the message of extracting from the connection of obtaining, processing method further comprises:
This connection is reconfigured to distributed file system.
In the present invention, mainly use the method for communication information scheduling, the method is divided into initiatively flow control feedback system and recipient's scheduling mode two parts, guarantees that entire system can efficient communication, the situation of traffic load inequality do not occur again.
Fig. 3 shows the signaling process of the active flow control feedback system in the processing method of communicating by letter in the distributed file system according to the embodiment of the invention, and detailed process is as follows:
Transmitted traffic control count value is set in initiator's path, in recipient's path, arranges and receive the flow control count value, be used for characterizing the message request number of initiator's transmission and the request number that the recipient has received.Initiator's control count value send_flow_nr is a maximum flow_max that path can send during initialization, and recipient's control count value recv_flow_nr is 0.
Message for each initiator's transmission, the initiator checks at first whether transmitted traffic control count value send_flow_nr is 0, if be 0, the communication information that has a large amount of dont answers on the expression path, then should send message queueing, and (send Flow Control send_flow_nr＞0) when wait can send and continue to send.The initiator successfully sends a communication request, reduces initiator's transmitted traffic control count value send_flow_nr.The initiator is after the processing that receives the recipient is replied, increase and send Flow Control count value send_flow_nr, and check whether message send queue exists and do not send message, do not send message if exist, then the message in the formation is carried out message according to this step and send.
The information receiving and transmitting total amount equals initiator's flow control counting and recipient's flow control counting sum, and, connecting in the situation that sends a piece of news by sending the initiator, initiator's flow control counting send_flow_nr reduces by a step-length; The recipient by the situation that receives a piece of news under, recipient's flow control counting recv_flow_nr increases a step-length; Process the recipient in the situation of a piece of news, initiator's flow control counting send_flow_nr increases by a step-length, and recipient's flow control counting recv_flow_nr reduces a step-length.For example, the recipient then will receive flow value recv_flow_nr+1 in the communication request that receives an initiator of success, after the recipient finishes dealing with this message, reply when finishing, and will receive flow value recv_flow_nr-1.
As recipient during in the received communication request, check to receive flow control count value recv_flow_nr, for example, if the flow counting surpasses the first proportion threshold value (2*flow_max/3), then to initiator's transmitted traffic control message MSG_FLOWCTRL_DOWN, notice can increase transmission speed.If the flow control count value is then sent flow control messages MSG_FLOWCTRL_UP to the initiator less than the second proportion threshold value flow_max/2, carry current recipient's flow control counting recv_flow_nr, inform that the initiator need to improve transmission speed; The initiator initiatively reduces transmission speed after receiving MSG_FLOWCTRL_DOWN; Receive MSG_FLOWCTRL_UP, initiatively increase transmission speed.The transmitted traffic control message can be carried in the message to be sent, reduces the information receiving and transmitting expense that Flow Control message is brought.Transmit leg can also exist one to send the message chained list simultaneously, if the initiator can not send, then message is placed into and sends the message chained list, when transmit leg receives replying of recipient, in the time of can continuing to send message, from send the message chained list, obtain message, continue to send.
Adjust the message transmission speed by the judgment mechanism of this message traffic and according to the testing result of flow, can avoid the congested of message, so that load further obtains equilibrium, and can improve the efficient of transmission of messages and processing.And it only is concrete example that above-mentioned flow is judged, in actual applications, the threshold value that other can be set is used for the judgement of flow.
The recipient that Fig. 4 shows in the processing method of communicating by letter in the distributed file system according to the embodiment of the invention connects the scheduling principle, and its detailed process is as follows:
The recipient a plurality of dissimilar wait receive datas are set and connect formation, for connecting dispatching algorithm.Method (function Poll and the Select during character device drives in such as Linux such as multiplexed that the recipient is using that operating system provides, the perhaps Epoll interface that provides of linux system) detect connect upper when having the message that needs to receive, receivable connection is placed in the different multi-link formations according to sorting technique, can be according to initiator's address (for example formation among Fig. 41, comprise and connect 1, connect 4, connect 5), receive priority (for example formation 2 among Fig. 4 that connects formation, comprise and connect 2, connect 3), receive connecting quantity (for example formation 3 among Fig. 4 comprises connecting 6) that formation receives message etc. classifies.
The recipient obtains connection one by one according to connecting scheduling rule from the formation that a plurality of wait receive datas connect, delete from connecting formation, and receipt message is also processed.Scheduling rule (method) comprise following one of arbitrarily:
(1) robin scheduling algorithm: the mode with circulation is obtained connection from each reception connection formation, for example, according to the queue distribution among Fig. 4, can carry out successively following obtaining step: from formation 1, obtain connection 1, from formation 2, obtain connection 2, from formation 3, obtain connection 6, from formation 1, obtain connection 4, from formation 2, obtain connection 3, from formation 1, obtain connection 5.
(2) priority scheduling algorithm: according to the priority orders that in advance connection is arranged, obtain connection with this from receiving the connection formation, when the connection in the connection formation of all high priorities after all receipt message is finished, could process the connection in the connection formation of low priority, for example, according to the queue distribution among Fig. 4, the priority of formation 1 is the highest, next is formation 2, the priority of formation 3 is minimum, therefore, at first obtains connection from formation 1, secondly obtain connection from formation 2, obtain connection from formation 3 at last.
(3) bandwidth balancing dispatching algorithm: according to the message number of each connection, receive the connection formation from each and obtain connection, to the data receiver request in each connection formation, record message-length or message number in this connection formation, guarantee that each connects the message size equilibrium that formation receives, for example, according to the queue distribution among Fig. 4, message-length in the formation 1 is maximum, secondly is formation 2, and the message-length in the formation 3 is minimum, therefore, at first obtain connection from formation 1, secondly obtain connection from formation 2, obtain connection from formation 3 at last.
The recipient according to the scheduling rule in the previous step to select (obtaining) to received connections carry out the message sink operation, and should connect from described reception connection formation and deleted.
The recipient after finishing message sink in the connection of choosing reconfigures connection to described distributed file system, and the multiplexed notice of waiting for that operating system provides receives and operate next time.
According to another aspect of the present invention, provide the processing unit of communicating by letter in a kind of distributed file system, the traffic operation in this distributed file system comprises initiator and the recipient of communication.
The processing unit of communicating by letter in the distributed file system according to the embodiment of the invention as shown in Figure 5, comprises:
This processing unit may further include the flow counting module, is used for carrying out flow control in this locality and counts;
This device can also comprise notification module, is used for result according to the flow control counting and notifies the initiator to increase transmission speed and/or reduce transmission speed and/or keep transmission speed.
And, the recipient receive and untreated size of message in the information receiving and transmitting total amount in the shared situation of ratio greater than the first proportion threshold value, then notification module notice transmit leg reduces the speed that sends message;
The recipient receive and untreated size of message shared ratio is less than the second proportion threshold value in the information receiving and transmitting total amount, then notification module notice transmit leg increases the speed that sends message;
Wherein, the information receiving and transmitting total amount equals initiator's flow control counting and recipient's flow control counting sum, and, connecting in the situation that sends a piece of news by sending the initiator, initiator's flow control counting reduces by a step-length; The recipient by the situation that receives a piece of news under, recipient's flow control counting increases a step-length; Process the recipient in the situation of a piece of news, initiator's flow control counting increases by a step-length, and recipient's flow control counting reduces a step-length.
In addition, sort module according to the sorting technique that sets in advance to the connection that receives classify comprise following one of at least:
Classify in address according to the initiator;
Classify according to receiving the priority that connects formation;
The quantity that receives message according to reception connection formation is classified.
And the recipient obtains to connect from reception connection formation and comprises:
Processing module is obtained connection according to pre-configured dispatching method from receiving the connection formation.
And, pre-configured dispatching method comprise following one of arbitrarily:
Mode with circulation is obtained connection from each reception connection formation;
To connecting the priority orders that arranges, obtain connection with this from receiving the connection formation according in advance;
According to the message number of each connection, receive the connection formation from each and obtain connection.
Wherein, after the message of extracting from the connection of obtaining, processing method also comprises:
Processing module can be deleted this connection from the reception connection formation at place.
Equally can be according to carrying out work with reference to the described method of Fig. 2 to 4 among the embodiment before according to said apparatus of the present invention, and reach identical effect, describe before detailed process and the details, no longer repeat here.
In sum, by means of technique scheme of the present invention, the present invention classifies to the connection from the initiator that receives according to the sorting technique that sets in advance by the recipient, corresponding connection formation is put in the connection of sorted each classification, and extract message and finish processing according to formation, can Effective Raise the efficient of transmission, and can and process the equilibrium that realizes load to the reception of message.
In addition, the invention allows for the communication information scheduling scheme in the distributed file system, can be based on the virtual link of software, the connection traffic control method of active feedback, can be further according to the size of message that sends and the size of message of reception and processing, reception and processing to message are optimized, and regulate in real time the transmission rate of message, help to optimize to utilize Internet resources.
The above only is preferred embodiment of the present invention, and is in order to limit the present invention, within the spirit and principles in the present invention not all, any modification of doing, is equal to replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (10)
1. the processing method of communicating by letter in the distributed file system, the traffic operation in this distributed file system comprises initiator and the recipient of communication, it is characterized in that, the treating method comprises:
Described recipient receives the connection from described initiator;
Described recipient classifies to the connection that receives according to the sorting technique that sets in advance;
For the connection of sorted each classification, described recipient puts into the reception corresponding with this classification with such other connection and connects formation;
Described recipient obtains connection from receive connecting formation, the message of from the connection of obtaining, extracting, and the described message of extracting processed.
2. processing method according to claim 1 is characterized in that, described processing method further comprises:
Set up in advance a plurality of virtual companies roads between described initiator and described recipient, and each virtual road that connects is arranged priority, wherein, described a plurality of virtual companies road is corresponding one by one with described connection.
3. processing method according to claim 1 is characterized in that, described processing method further comprises:
Described initiator and described recipient carry out the flow control counting in this locality separately, described recipient adjusts the speed of described initiator's transmission message according to the result of flow control counting.
4. processing method according to claim 3, it is characterized in that, described recipient receive and untreated size of message in the information receiving and transmitting total amount in the shared situation of ratio greater than the first proportion threshold value, described recipient notifies described transmit leg to reduce the speed that sends message;
Described recipient receive and untreated size of message in the information receiving and transmitting total amount in the shared situation of ratio less than the second proportion threshold value, described recipient notifies described transmit leg to increase the speed that sends message; Wherein, described the first proportion threshold value is greater than described the second proportion threshold value;
Wherein, described information receiving and transmitting total amount equals described initiator's flow control counting and described recipient's flow control counting sum, and, connecting in the situation that sends a piece of news by sending described initiator, described initiator's flow control counting reduces by a step-length; Described recipient by the situation that receives a piece of news under, described recipient's flow control counting increases a step-length; Process described recipient in the situation of a piece of news, described initiator's flow control counting increases by a step-length, and described recipient's flow control counting reduces a step-length.
5. processing method according to claim 1 is characterized in that, described recipient according to the sorting technique that sets in advance to the connection that receives classify comprise following one of at least:
Classify in address according to described initiator;
The priority that connects formation according to described reception is classified;
Classify according to the quantity that described reception connection formation receives message.
6. processing method according to claim 1 is characterized in that, described recipient obtains to connect from reception connection formation and comprises:
Described recipient obtains connection according to pre-configured dispatching method from receiving the connection formation.
7. processing method according to claim 1 is characterized in that, described pre-configured dispatching method comprise following one of arbitrarily:
Mode with circulation is obtained connection from each reception connection formation;
To connecting the priority orders that arranges, obtain connection with this from receiving the connection formation according in advance;
According to the message number of each connection, receive the connection formation from each and obtain connection.
8. processing method according to claim 1 is characterized in that, after the message of extracting from the connection of obtaining, described processing method also comprises:
This connection is deleted from the reception connection formation at place.
9. processing method according to claim 1 is characterized in that, after the message of extracting from the connection of obtaining, described processing method further comprises:
This connection is reconfigured to described distributed file system.
10. the processing unit of communicating by letter in the distributed file system, the traffic operation in this distributed file system comprises initiator and the recipient of communication, it is characterized in that, described processing unit comprises:
Receiver module is used for receiving the connection from described initiator;
Sort module is used for according to the sorting technique that sets in advance the connection that receives being classified;
Configuration module is used for the connection for sorted each classification, the reception corresponding with this classification is put in such other connection connect formation;
Processing module is used for connecting formation and obtaining connection from receiving, the message of from the connection of obtaining, extracting, and the described message of extracting processed.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210564509XA CN103067474A (en) | 2012-12-21 | 2012-12-21 | Processing method and device for communication in distributed file system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210564509XA CN103067474A (en) | 2012-12-21 | 2012-12-21 | Processing method and device for communication in distributed file system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103067474A true CN103067474A (en) | 2013-04-24 |
Family
ID=48109928
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210564509XA Pending CN103067474A (en) | 2012-12-21 | 2012-12-21 | Processing method and device for communication in distributed file system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103067474A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104243587A (en) * | 2014-09-18 | 2014-12-24 | 苏州阔地网络科技有限公司 | Load balancing method and system for message servers |
| CN104702534A (en) * | 2015-03-30 | 2015-06-10 | 无锡天脉聚源传媒科技有限公司 | Method and device for processing data of multi-process sharing port |
| CN105516276A (en) * | 2015-11-30 | 2016-04-20 | 中电科华云信息技术有限公司 | Message processing method and system based on bionic hierarchical communication |
| CN107222435A (en) * | 2016-03-21 | 2017-09-29 | 深圳市中兴微电子技术有限公司 | Eliminate the method and device for exchanging head resistance of message |
| CN107479955A (en) * | 2017-08-04 | 2017-12-15 | 南京华飞数据技术有限公司 | A kind of efficient response method based on Epoll async servers |
| CN111866148A (en) * | 2020-07-23 | 2020-10-30 | 浪潮云信息技术股份公司 | Message queue flow control system |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101340358A (en) * | 2007-07-04 | 2009-01-07 | 鼎桥通信技术有限公司 | Flow control method, system and flow control entity |
| CN101834787A (en) * | 2010-04-12 | 2010-09-15 | 中兴通讯股份有限公司 | Method and system for dispatching data |
| CN102035748A (en) * | 2010-12-31 | 2011-04-27 | 深圳市深信服电子科技有限公司 | Application-based traffic control method and controller |
-
2012
- 2012-12-21 CN CN201210564509XA patent/CN103067474A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101340358A (en) * | 2007-07-04 | 2009-01-07 | 鼎桥通信技术有限公司 | Flow control method, system and flow control entity |
| CN101834787A (en) * | 2010-04-12 | 2010-09-15 | 中兴通讯股份有限公司 | Method and system for dispatching data |
| CN102035748A (en) * | 2010-12-31 | 2011-04-27 | 深圳市深信服电子科技有限公司 | Application-based traffic control method and controller |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104243587A (en) * | 2014-09-18 | 2014-12-24 | 苏州阔地网络科技有限公司 | Load balancing method and system for message servers |
| CN104702534A (en) * | 2015-03-30 | 2015-06-10 | 无锡天脉聚源传媒科技有限公司 | Method and device for processing data of multi-process sharing port |
| CN104702534B (en) * | 2015-03-30 | 2018-02-06 | 无锡天脉聚源传媒科技有限公司 | A kind of method and device for the data processing for realizing multi-process shared port |
| CN105516276A (en) * | 2015-11-30 | 2016-04-20 | 中电科华云信息技术有限公司 | Message processing method and system based on bionic hierarchical communication |
| CN107222435A (en) * | 2016-03-21 | 2017-09-29 | 深圳市中兴微电子技术有限公司 | Eliminate the method and device for exchanging head resistance of message |
| CN107222435B (en) * | 2016-03-21 | 2020-07-24 | 深圳市中兴微电子技术有限公司 | Method and device for eliminating exchange head resistance of message |
| CN107479955A (en) * | 2017-08-04 | 2017-12-15 | 南京华飞数据技术有限公司 | A kind of efficient response method based on Epoll async servers |
| CN107479955B (en) * | 2017-08-04 | 2020-04-17 | 南京华飞数据技术有限公司 | Efficient response method based on Epoll asynchronous server |
| CN111866148A (en) * | 2020-07-23 | 2020-10-30 | 浪潮云信息技术股份公司 | Message queue flow control system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103067474A (en) | Processing method and device for communication in distributed file system | |
| CN101335709B (en) | Method for implementing load sharing among flow analysis servers and shunting equipment | |
| US9185047B2 (en) | Hierarchical profiled scheduling and shaping | |
| Guo et al. | Resource allocation for high-reliability low-latency vehicular communications with packet retransmission | |
| CN108259383A (en) | The transmission method and the network equipment of a kind of data | |
| CN101170512B (en) | Message service processing method | |
| CN105847139A (en) | Data transmission method, apparatus and system | |
| CN111181873B (en) | Data transmission method, data transmission device, storage medium and electronic equipment | |
| CN106130925A (en) | Link scheduling method, equipment and the system of a kind of SDN | |
| CN108810927A (en) | A kind of processing method and system of scheduling request | |
| CN103368868A (en) | Network flow bandwidth control method, device and system | |
| CN107864189A (en) | A kind of application layer traffic load-balancing method based on DPI | |
| CN101459615A (en) | Method, terminal port and system for packet transmission | |
| CN101594642B (en) | Resource allocation method and resource allocation device used for communication network element device | |
| CN105429881A (en) | Multicast message forwarding method and device | |
| CN109361749A (en) | Message processing method, relevant device and computer storage medium | |
| CN105764091A (en) | Method of effectively utilizing wireless bandwidth | |
| CN102281202A (en) | Dispatching method, server and system | |
| CN102195931A (en) | Method for multicast traffic forwarding in equipment, network equipment and line card | |
| CN115190537A (en) | Wireless link dynamic selection method and system | |
| CN106209676A (en) | The data processing method of cloud host computer systems based on many equipment and device | |
| CN102685227A (en) | Message scheduling method and message scheduling system for cloud conference | |
| WO2015007100A1 (en) | Method and system for controlling communication traffic | |
| CN104270321A (en) | Network load balancing method and system | |
| CN105871747B (en) | Communication system downlink data transmission method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20130424 |