CN102457906A - Load balancing control method and system of message queues - Google Patents

Load balancing control method and system of message queues Download PDF

Info

Publication number
CN102457906A
CN102457906A CN2010105233917A CN201010523391A CN102457906A CN 102457906 A CN102457906 A CN 102457906A CN 2010105233917 A CN2010105233917 A CN 2010105233917A CN 201010523391 A CN201010523391 A CN 201010523391A CN 102457906 A CN102457906 A CN 102457906A
Authority
CN
China
Prior art keywords
message queue
depth
business service
queue
application server
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2010105233917A
Other languages
Chinese (zh)
Other versions
CN102457906B (en
Inventor
崔洪涛
郭强
邵杰
盛强
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Mobile Group Henan Co Ltd
Original Assignee
China Mobile Group Henan Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Mobile Group Henan Co Ltd filed Critical China Mobile Group Henan Co Ltd
Priority to CN201010523391.7A priority Critical patent/CN102457906B/en
Publication of CN102457906A publication Critical patent/CN102457906A/en
Application granted granted Critical
Publication of CN102457906B publication Critical patent/CN102457906B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Computer And Data Communications (AREA)
  • Telephonic Communication Services (AREA)

Abstract

The invention discloses a load balancing control method and system of message queues, which are used for improving the flexibility of load balancing control of the message queues and ensuring that a client side flexibly switches the message queues. The load balancing control method of the message queues comprises the following steps of: polling the current depth of each message queue, and generating alarm information when overload message queues about that the current depth is up to a preset queue depth alarm threshold value exist, wherein the alarm information contains identification information and the current depth of each overload message queue; respectively determining the amount of business service required to be increased for each overload message queue according to the current depth of each overload message queue in the alarm information and the average handling ability of the business service; and selecting a corresponding amount of business service meeting an allocation condition, and increasing the overload message queues indicated by the identification information allocated to each overload message queue in the alarm information.

Description

A kind of control method for equalizing load of message queue and system
Technical field
The present invention relates to the mobile communication technology field, relate in particular to a kind of control method for equalizing load and system of message queue.
Background technology
In the existing mobile communication technology field; The major function of precision marketing system is processing signaling acquisition system, BOSS (Business Operation Support System; Service operation supports) a large amount of real time datas of producing of external system such as system; Filter and processed generation business event,, finally the user is marketed through suitable channel through the processing of application server to business event.
The signaling data that the signaling acquisition system collection is a large amount of, for example calling and called, short message receiving-transmitting, position migration, sub-district switching, switching on and shutting down etc., and send to the front end processor of precision marketing system through the Socket interface, peak rate reaches 1500000/second; The BOSS system also produces the front end processor that a large amount of IT incidents sends to the precision marketing system.A large amount of real time datas that external systems such as signaling acquisition system, BOSS system produce are again lacks of balance, and for example the calling and called in the signaling data, short message receiving-transmitting show non-equilibrium in each time period of every day.Real time data to big data quantity and lack of balance in the precision marketing system; In order to reach the requirement of high real-time and high reliability; The precision marketing system need be designed to elasticity computation structure; Share the data processing of big data quantity and lack of balance, keep out surge pressure, thereby guarantee the real-time and the reliability of precision marketing system.Wherein, through the message encapsulation business event is distributed to message queue in the precision marketing system, therefore needs to realize the load balancing of message queue.
In the prior art, the load balancing scheme of message queue, as shown in Figure 1:
A plurality of message queues are formed the message queue cluster, and message at first sends to major queue, is carried out the distribution of message again by major queue, and the load balancing strategy is controlled by major queue; Extract message in the message queue that client is fixed and carry out Business Processing from the message queue cluster.
In the prior art, there is following problem in the load balancing scheme of message queue:
1, a plurality of message queues are formed the message queue cluster, and message at first sends to major queue, is carried out the distribution of message again by major queue, and the load balancing strategy is controlled by major queue, can't adjust the load balancing strategy neatly;
2, extract message in the message queue that client is fixed and carry out Business Processing from the message queue cluster, client can't be switched message queue pellucidly.
Therefore, how to promote the flexibility of control messages formation load balancing, and realize the flexible switching of client, become the technical problem that needs to be resolved hurrily in the prior art message queue.
Summary of the invention
The embodiment of the invention provides a kind of control method for equalizing load and system of message queue, in order to the flexibility of lifting control messages formation load balancing, and realizes the flexible switching of client to message queue.
The control method for equalizing load of the message queue that the embodiment of the invention provides comprises:
The current degree of depth of each message queue of poll when existing the current degree of depth to reach the overload message queue of preset queue depth's alarm threshold, generates warning information, comprises the identification information and the current degree of depth thereof of respectively transshipping message queue in the said warning information;
According to respectively transshipping the current degree of depth of message queue and the average treatment ability of business service in the warning information, the business service quantity that the message queue of confirming respectively respectively to transship need increase;
Choose respective numbers and satisfy the business service of configuration condition, increase configuration and give and respectively transship the indicated overload message queue of identification information of message queue in the warning information.
The load balancing control system of the message queue that the embodiment of the invention provides comprises:
Monitoring module; The current degree of depth that is used for each message queue of poll; When existing the current degree of depth to reach the overload message queue of preset queue depth's alarm threshold; Generate warning information and send to the Balance Control module, comprise the identification information and the current degree of depth thereof of respectively transshipping message queue in the said warning information;
RACS is used for respectively transshipping the current degree of depth of message queue and the average treatment ability of business service according to warning information, the business service quantity that the message queue of confirming respectively respectively to transship need increase; Choose respective numbers and satisfy the business service of configuration condition, increase configuration and give and respectively transship the indicated overload message queue of identification information of message queue in the warning information.
The control method for equalizing load of the message queue that the embodiment of the invention provides and system; Abandoned by the balanced pattern of major queue control load; The current degree of depth through each message queue of poll; When the queue depth of some or a plurality of message queues reaches the queue depth alarm threshold of setting, the business service quantity that the message queue of confirming respectively to transship need increase, and the business service that will satisfy configuration condition increases configuration to each overload message queue; Thereby reached the purpose of control messages formation load balancing, promoted flexibility; Business service is no longer extracted message and is carried out Business Processing from fixing message queue, but can realize the flexible switching of client to message queue according to actual conditions flexibly for the service of message queue configuration service.
Other features and advantages of the present invention will be set forth in specification subsequently, and, partly from specification, become obvious, perhaps understand through embodiment of the present invention.The object of the invention can be realized through the structure that in the specification of being write, claims and accompanying drawing, is particularly pointed out and obtained with other advantages.
Description of drawings
Fig. 1 is the load balancing scheme sketch map of message queue in the prior art;
Fig. 2 is the configuration diagram of precision marketing system in the embodiment of the invention;
Fig. 3 is the sketch map of service managerZ-HU management service service in the embodiment of the invention;
Fig. 4 is the register flow path figure of business service in the embodiment of the invention;
Fig. 5 is the load balancing control system block diagram of message queue in the embodiment of the invention;
Fig. 6 is the control method for equalizing load flow chart of message queue in the embodiment of the invention;
Fig. 7 is the load balancing control flow chart of first kind of message queue in the embodiment of the invention;
Fig. 8 is the load balancing control flow chart of second kind of message queue in the embodiment of the invention.
Embodiment
The embodiment of the invention provides a kind of control method for equalizing load and system of message queue, in order to the flexibility of lifting control messages formation load balancing, and realizes the flexible switching of client to message queue.
Below in conjunction with Figure of description the preferred embodiments of the present invention are described; Be to be understood that; Preferred embodiment described herein only is used for explanation and explains the present invention; And be not used in qualification the present invention, and under the situation of not conflicting, embodiment and the characteristic among the embodiment among the present invention can make up each other.
The typical application scene of the load balancing controlling schemes of the message queue that at first, the embodiment of the invention is provided adopts the precision marketing system of elasticity computation structure to describe one by one.The elasticity computation structure of precision marketing system is based upon on the SOA (Service-Oriented Architecture, Service-Oriented Architecture Based) of employing based on message-oriented middleware.SOA is a kind of framework model, can carry out distributed deployment, combination and use through network to loosely-coupled coarseness application component according to demand; Service layer is the basis of SOA, can directly be employed to call, thereby effectively in the control system with the mutual artificial dependence of ageng.The framework of precision marketing system, as shown in Figure 2:
In the precision marketing system, each module is articulated to message-oriented middleware through the message encapsulation, and service or outwards request service externally are provided.Three types of critical pieces that elasticity is calculated: monitor service, Balance Control service and business service all are the basis with SOA, in the precision marketing system, all encapsulate and dispose with message based service form.Wherein, the functional entity of having disposed monitor service is called monitoring module, and the functional entity of having disposed the Balance Control service is called the Balance Control module, and the functional entity of having disposed business service is called application server, and message queue is deployed in the queue management device.
The IT incident that the signaling data of signaling acquisition system collection and BOSS system produce sends to the front end processor of precision marketing system; Processing module in the front end processor is filtered and processed the signaling data or the IT incident that receive, obtains business event; Distribution module in the front end processor is responsible for the business event that processing module obtains is distributed; Through the message encapsulation business event is distributed to the message queue in the queue management device, the business service in the application server is extracted business event again and is handled from the message queue of correspondence.
Business service is the service of the concrete business event processing logic of precision marketing system in package, will be deployed to one or more application servers.When the precision marketing system need increase the business event disposal ability, will start a plurality of business service instances, the computing capability that makes full use of application server is carried out distributed treatment.
Different with the business service of other system, each business service that need carry out flexible scheduling all will be to the Balance Control service report running status of precision marketing system, receives to start and cease and desist order.In the embodiment of the invention, designed service managerZ-HU and separated this partial function, as shown in Figure 3, be responsible for and the Balance Control service interaction by service managerZ-HU, accomplish the registration of business service, and start or stop business service.
To a certain specific business service in the application server, its register flow path is as shown in Figure 4, comprises the steps:
S401, service managerZ-HU initiate the register requirement of business service to the Balance Control module, wherein carry the identification information of business service;
S402, Balance Control module are according to the register requirement of business service; Issue the configuration messages that comprises the message queue link information through service managerZ-HU to business service, the message queue link information comprises the identification information of institute's connection message formation, the address information of institute's connection message formation place queue management device;
S403, business service are connected to the message queue of appointment according to the message queue link information in the configuration messages;
Follow-up, this specific business service can be obtained the needs processing from the message queue that is connected business event carries out Business Processing.
It is thus clear that the business service that through part is deployed on the application server of some can be used as cluster, the message queue that each business service is corresponding unique, the corresponding one or more business service of each message queue.
To registered business service, the Balance Control service can also start and cease and desist order to the issue of a certain specific business service, service managerZ-HU receive start or stop order after, start or stop corresponding business service.Wherein:
Start business service:
Service managerZ-HU starts business service as common thread, the issued state Notification of Changes has changed to starting state to this business service of Balance Control service report simultaneously;
Stop business service:
The service managerZ-HU calling external program normally withdraws from business service from circulation, and the issued state Notification of Changes has changed to halted state to this business service of Balance Control service report simultaneously.
Based on the elasticity computation structure of above-mentioned precision marketing system, the embodiment of the invention provides a kind of load balancing control system of message queue, and is as shown in Figure 5, comprises monitoring module 51 and RACS 52, and monitoring module 51 is connected to each message queue.Wherein:
Monitoring module 51; The current degree of depth that is used for each message queue of poll; When existing the current degree of depth to reach the overload message queue of preset queue depth's alarm threshold; Generate warning information and send to the Balance Control module, comprise the identification information and the current degree of depth thereof of respectively transshipping message queue in the said warning information;
For the ease of distinguishing, the message queue that in the embodiment of the invention the current degree of depth is reached preset queue depth's alarm threshold is called " overload message queue ";
RACS 52 is used for respectively transshipping the current degree of depth of message queue and the average treatment ability of business service according to warning information, the business service quantity that the message queue of confirming respectively respectively to transship need increase; Choose respective numbers and satisfy the business service of configuration condition, increase configuration and give and respectively transship the indicated overload message queue of identification information of message queue in the warning information.
In the practical implementation, a kind of possibility implementation of RACS 52 comprises Balance Control module 521 and service managerZ-HU 522, wherein:
Balance Control module 521 is used to inquire about the cpu busy percentage of each application server, confirms that cpu busy percentage is lower than the idle application server of the first utilance threshold value of setting; The Balance Control module initiate to start the control command of business service to service managerZ-HU, wherein indicates idle application server and carry respectively to transship the business service quantity that the identification information and needing of message queue increases;
Service managerZ-HU 522 is used for according to the control command that starts business service, is respectively each overload message queue and starts respective numbers and be deployed in the business service in the idle application server.
Preferable, Balance Control module 521 also is used for when the current depth recovery of certain overload message queue is arrived under its queue depth's alarm threshold, inquiring about the cpu busy percentage of each application server; If exist cpu busy percentage to be higher than the busy application server of the second utilance threshold value of setting; Initiate to stop the control command of business service to service managerZ-HU; Wherein indicate busy application server and carry the identification information of this overload message queue, the said second utilance threshold value is higher than the first utilance threshold value;
Service managerZ-HU 522 also is used for according to stopping the control command of business service, stop to dispose for this overload message queue and be deployed in the business service in the busy application server.
Respectively transship the identification information and the current degree of depth thereof of message queue except comprising in the warning information that monitoring module generates, can also comprise: the identification information of other message queue and the current degree of depth thereof; In this case, the another kind of RACS possibility implementation comprises Balance Control module 521 and service managerZ-HU 522, wherein:
Balance Control module 521; Be used to the pairing business service of message queue that each the overload message queue increase configuration respective numbers and the current degree of depth are lower than queue depth's scheduling threshold value of setting, said queue depth scheduling threshold value is lower than queue depth's alarm threshold; Issue the configuration update message that comprises the message queue link information through management server 522 to said business service, the message queue link information is used to indicate business service to be connected to the overload message queue of appointment.
Based on same technical conceive; The embodiment of the invention provides a kind of control method for equalizing load of message queue; The current degree of depth through message queue embodies data processing pressure, therefore needs in advance for each message queue is provided with queue depth's alarm threshold, and the queue depth's alarm threshold that is provided with for each message queue can be identical; Also can be inequality, can be provided with flexibly according to the actual requirements.As shown in Figure 6, the control method for equalizing load of the message queue that the embodiment of the invention provides comprises the steps:
The current degree of depth of S601, each message queue of poll; When existing the current degree of depth to reach the overload message queue of preset queue depth's alarm threshold; Generate warning information, comprise the identification information and the current degree of depth thereof of respectively transshipping message queue in the said warning information;
In the practical implementation, can be according to the current degree of depth of Fixed Time Interval (this Fixed Time Interval can be called monitoring period) each message queue of poll; Also can be when satisfying the trigger condition of setting, for example the user triggers the inquiry of queue depth, the current degree of depth of each message queue of poll.
S602, according to respectively transshipping the current degree of depth of message queue and the average treatment ability of business service in the warning information, the business service quantity that the message queue of confirming respectively respectively to transship need increase;
In the practical implementation, the average treatment ability of business service can be confirmed also pre-configured through following mode:
The application server that business service is provided is carried out POC (Proof of Concept) benchmark test; Draw under the typical services scene; The POC fiducial value of application server and business service maximum quantity, the POC fiducial value is meant the performance number of application server processes message, unit be generally the bar number/minute; The business service maximum quantity is meant the maximum quantity of the business service that application server can be disposed under the optimum performance; Need to prove, in the practical implementation, each application server performance basically identical of business service is provided.Based on POC benchmark test, can obtain the average treatment ability of business service, concrete computational methods are shown in formula [1]:
The average treatment ability of business service=POC fiducial value/business service maximum quantity [1]
Average treatment ability according to business service; And the current degree of depth (generally adopting the bar numerical table of message to show) of overload message queue; Can obtain the business service quantity that each overload message queue need increase; The quantity of supposing the overload message queue is N, then i (the business service quantity that the individual overload message queue of 1≤i≤N) need increase, concrete computational methods are shown in formula [2]:
Business service quantity=the P that needs increase i/ T [2]
Wherein, P iRepresent that (the current degree of depth of individual overload message queue of 1≤i≤N), T representes the average treatment ability of business service to i.
S603, choose respective numbers and satisfy the business service of configuration condition, increase configuration and give and respectively transship the indicated overload message queue of identification information of message queue in the warning information.
Below specify the load balancing controlling schemes of message queue through embodiment.
In order to reach the purpose of control messages formation load balancing; The control command of the startup business service that can initiate by service managerZ-HU receiving balance control module; Thereby guarantee that the precision marketing system is when facing the real time data of big data quantity and lack of balance; Can keep high real-time and high reliability, suppose that monitoring module presses the current degree of depth of each message queue of Fixed Time Interval poll.As shown in Figure 7, comprise the steps:
S701, when current monitoring period arrives, the current degree of depth of each message queue of monitoring module poll, and upgrade the current degree of depth of stored message formation in the monitoring module;
Reach preset queue depth's alarm threshold if the S702 monitoring module monitors the current degree of depth of some or a plurality of message queues, these one or more message queues are called the overload message queue, then carry out S703;
If monitoring module does not monitor the message queue that the current degree of depth reaches queue depth's alarm threshold of setting, then do not carry out any processing, wait for the arrival of next monitoring period;
S703, monitoring module generate warning information and send to the Balance Control module, need comprise the identification information and the current degree of depth thereof of respectively transshipping message queue in the warning information;
Describe for example:
Table 1
Figure BSA00000323643500091
Suppose that monitoring module has connected four message queues, numbering is respectively 1,2,3,4, and the maximum queue depth of each message queue and queue depth's alarm threshold see also table 1.When current monitoring period arrived, it is as shown in table 1 that monitoring module inquires the current degree of depth of each message queue.Based on above-mentioned Query Result; The current degree of depth that monitoring module monitors message queue 1 and message queue 2 reaches preset queue depth's alarm threshold; Then generate warning information and send to the Balance Control module, need comprise the identification information and the current degree of depth thereof of transshipping message queue in the warning information.The identification information of message queue of wherein transshipping can adopt the numbering of message queue, also can adopt the title etc. of message queue; Can get final product by message queue of unique identification; Suppose to adopt the numbering of message queue, then comprise following information in the warning information: (1,1000000); (2,1000000);
After S704, Balance Control module receive warning information, according to the current degree of depth and the average treatment ability of business service of each overload message queue, the business service quantity that the message queue of confirming respectively respectively to transship need increase;
The business service quantity that supposing to determine message queue 1 needs to increase is M 1, the message queue 2 business service quantity that needs to increase is M 2
The cpu busy percentage of S705, each application server of Balance Control module inquiry; Obtain the idle application server that cpu busy percentage is lower than the first utilance threshold value of setting; The first utilance threshold value can be set according to actual conditions flexibly; For example be set at 10%, 5% or the like, be no more than 50% generally speaking;
S706, Balance Control module initiate to start the control command of business service to service managerZ-HU, wherein indicate idle application server and carry respectively to transship the business service quantity that the identification information and needing of message queue increases;
S707, service managerZ-HU are respectively the business service that each overload message queue starts respective numbers according to the control command of business service in idle application server; Need to prove that because the service managerZ-HU unified management is deployed in the business service in the application server, so service managerZ-HU can be known the business service distributed intelligence of each application server;
For example, be message queue 1 startup M according to the result of calculation of S704 1Individual business service is for message queue 2 starts M 2Individual business service.
S708, service managerZ-HU are to Balance Control module feedback states Notification of Changes, and the report corresponding business service has changed to starting state.
S704 and S705 are the load balancing control strategies of presetting, and according to the cpu busy percentage that inquires, obtain the idle application server of dispersion as far as possible, make new business service of opening be dispersed in each idle application server, help improving bandwidth availability ratio.S706 and S707 are the operating parts to the load balancing control strategy, make that the business service on the more application services device starts, and are connected to message queue parallel processing business event.
In order to realize inquiry to the cpu busy percentage of each application server, in the practical implementation, can use the Linux script that monitor message is write file, be uploaded to the Balance Control module by program through message queue again.
In the practical implementation, after the queue depth of overload message queue recovered normally, the Balance Control module can also be through the cpu busy percentage of each application server of inquiry, and the notification service manager stops corresponding business service, specifically comprises the steps:
Step 1, when the current depth recovery of certain overload message queue is under its queue depth's alarm threshold, the cpu busy percentage of each application server of Balance Control module inquiry;
If step 2 exists cpu busy percentage to be higher than the busy application server of the second utilance threshold value of setting; The Balance Control module initiates to stop the control command of business service to service managerZ-HU; Wherein indicate busy application server and carry the identification information of this overload message queue, the said second utilance threshold value is higher than the first utilance threshold value;
Step 3, service managerZ-HU be according to the control command that stops business service, stop to dispose for this overload message queue and be deployed in the business service in the busy application server.
In order to reach the purpose of control messages formation load balancing; Can be by the configuration update message that comprises the message queue link information of service managerZ-HU receiving balance control module initiation; Be updated to the business service of overload message queue service; Thereby guarantee that the precision marketing system in the face of the real time data of big data quantity and lack of balance the time, can keep high real-time and high reliability, suppose that monitoring module presses the current degree of depth of each message queue of Fixed Time Interval poll.As shown in Figure 8, comprise the steps:
S801, when current monitoring period arrives, the current degree of depth of each message queue of monitoring module poll, and upgrade the current degree of depth of stored message formation in the monitoring module;
Reach preset queue depth's alarm threshold if the S802 monitoring module monitors the current degree of depth of some or a plurality of message queues, these one or more message queues are called the overload message queue, then carry out S803;
If monitoring module does not monitor the message queue that the current degree of depth reaches queue depth's alarm threshold of setting, then do not carry out any processing, wait for the arrival of next monitoring period;
S803, monitoring module generate warning information and send to the Balance Control module, respectively transship the identification information and the current degree of depth thereof of message queue except comprising in the warning information, also comprise the identification information and the current degree of depth thereof of other message queue;
After S804, Balance Control module receive warning information, according to the current degree of depth and the average treatment ability of business service of each overload message queue, the business service quantity that the message queue of confirming respectively respectively to transship need increase;
S805, Balance Control module increase the pairing business service of message queue that the current degree of depth that disposes respective numbers is lower than queue depth's scheduling threshold value of setting for each overload message queue; Wherein, queue depth's scheduling threshold value is less than queue depth's alarm threshold;
S806, Balance Control module comprise the configuration update message of message queue link information to above-mentioned each business service issue through management server;
S807, corresponding business service are connected to the overload message queue of appointment according to the message queue link information in the configuration update message.
The control method for equalizing load of the message queue that the embodiment of the invention provides and system; Abandoned by the balanced pattern of major queue control load; The current degree of depth through each message queue of poll; When the queue depth of some or a plurality of message queues reaches the queue depth alarm threshold of setting, the business service quantity that the message queue of confirming respectively to transship need increase, and the business service that will satisfy configuration condition increases configuration to each overload message queue; Thereby reached the purpose of control messages formation load balancing, promoted flexibility; Business service is no longer extracted message and is carried out Business Processing from fixing message queue, but can realize the flexible switching of client to message queue according to actual conditions flexibly for the service of message queue configuration service.
Obviously, those skilled in the art can carry out various changes and modification to the present invention and not break away from the spirit and scope of the present invention.Like this, belong within the scope of claim of the present invention and equivalent technologies thereof if of the present invention these are revised with modification, then the present invention also is intended to comprise these changes and modification interior.

Claims (10)

1. the control method for equalizing load of a message queue is characterized in that, comprising:
The current degree of depth of each message queue of poll when existing the current degree of depth to reach the overload message queue of preset queue depth's alarm threshold, generates warning information, comprises the identification information and the current degree of depth thereof of respectively transshipping message queue in the said warning information;
According to respectively transshipping the current degree of depth of message queue and the average treatment ability of business service in the warning information, the business service quantity that the message queue of confirming respectively respectively to transship need increase;
Choose respective numbers and satisfy the business service of configuration condition, increase configuration and give and respectively transship the indicated overload message queue of identification information of message queue in the warning information.
2. the method for claim 1 is characterized in that, the said business service of choosing respective numbers and satisfying configuration condition increases configuration and gives and respectively transship the indicated overload message queue of identification information of message queue in the warning information, specifically comprises:
Inquire about the cpu busy percentage of each application server, confirm that cpu busy percentage is lower than the idle application server of the first utilance threshold value of setting, disposes business service in the said application server;
For each overload message queue starts respective numbers and is deployed in the business service in the idle application server.
3. method as claimed in claim 2 is characterized in that, also comprises:
When the current depth recovery of certain overload message queue is arrived under its queue depth's alarm threshold, inquire about the cpu busy percentage of each application server;
If exist cpu busy percentage to be higher than the busy application server of the second utilance threshold value of setting; Then stop for the configuration of this overload message queue and be deployed in the business service in the busy application server, the said second utilance threshold value is higher than the first utilance threshold value.
4. the method for claim 1 is characterized in that, also comprises in the said warning information: the identification information of other message queue and the current degree of depth thereof; And
The said business service of choosing respective numbers and satisfying configuration condition increases configuration and gives and respectively transship the indicated overload message queue of identification information of message queue in the warning information, specifically comprises:
For each overload message queue increases the pairing business service of message queue that configuration respective numbers and the current degree of depth are lower than queue depth's scheduling threshold value of setting, said queue depth scheduling threshold value is lower than queue depth's alarm threshold;
The configuration update message that comprises the message queue link information to said business service issue; And
Said business service is connected to the overload message queue of appointment according to the message queue link information in the configuration update message.
5. the method for claim 1 is characterized in that, the overload message queue business service quantity that need increase is the merchant of the average treatment ability of the current degree of depth of this overload message queue and business service.
6. the method for claim 1 is characterized in that, according to the current degree of depth of regular time interval each message queue of poll.
7. the load balancing control system of a message queue is characterized in that, comprising:
Monitoring module; The current degree of depth that is used for each message queue of poll; When existing the current degree of depth to reach the overload message queue of preset queue depth's alarm threshold; Generate warning information and send to the Balance Control module, comprise the identification information and the current degree of depth thereof of respectively transshipping message queue in the said warning information;
RACS is used for respectively transshipping the current degree of depth of message queue and the average treatment ability of business service according to warning information, the business service quantity that the message queue of confirming respectively respectively to transship need increase; Choose respective numbers and satisfy the business service of configuration condition, increase configuration and give and respectively transship the indicated overload message queue of identification information of message queue in the warning information.
8. system as claimed in claim 7 is characterized in that said RACS comprises Balance Control module and service managerZ-HU, wherein:
Said Balance Control module is used to inquire about the cpu busy percentage of each application server, confirms that cpu busy percentage is lower than the idle application server of the first utilance threshold value of setting, disposes business service in the said application server; Initiate to start the control command of business service to said service managerZ-HU, wherein indicate idle application server and carry and respectively transship the business service quantity that the identification information and needing of message queue increases;
Said service managerZ-HU is used for according to the control command that starts business service, is respectively each overload message queue and starts respective numbers and be deployed in the business service in the idle application server.
9. system as claimed in claim 8 is characterized in that,
Said Balance Control module also is used for when the current depth recovery of certain overload message queue is arrived under its queue depth's alarm threshold, inquiring about the cpu busy percentage of each application server; If exist cpu busy percentage to be higher than the busy application server of the second utilance threshold value of setting; Initiate to stop the control command of business service to service managerZ-HU; Wherein indicate busy application server and carry the identification information of this overload message queue, the said second utilance threshold value is higher than the first utilance threshold value;
Service managerZ-HU also is used for according to stopping the control command of business service, stop to dispose for this overload message queue and be deployed in the business service in the busy application server.
10. system as claimed in claim 7 is characterized in that,
Also comprise in the warning information that said monitoring module generates: the identification information of other message queue and the current degree of depth thereof; And
Said RACS comprises Balance Control module and service managerZ-HU, wherein:
The Balance Control module; Be used to the pairing business service of message queue that each the overload message queue increase configuration respective numbers and the current degree of depth are lower than queue depth's scheduling threshold value of setting, said queue depth scheduling threshold value is lower than queue depth's alarm threshold; Issue the configuration update message that comprises the message queue link information through said management server to said business service, the message queue link information is used to indicate business service to be connected to the overload message queue of appointment.
CN201010523391.7A 2010-10-26 2010-10-26 Load balancing control method and system of message queues Active CN102457906B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201010523391.7A CN102457906B (en) 2010-10-26 2010-10-26 Load balancing control method and system of message queues

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201010523391.7A CN102457906B (en) 2010-10-26 2010-10-26 Load balancing control method and system of message queues

Publications (2)

Publication Number Publication Date
CN102457906A true CN102457906A (en) 2012-05-16
CN102457906B CN102457906B (en) 2014-01-08

Family

ID=46040428

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201010523391.7A Active CN102457906B (en) 2010-10-26 2010-10-26 Load balancing control method and system of message queues

Country Status (1)

Country Link
CN (1) CN102457906B (en)

Cited By (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103927218A (en) * 2014-04-30 2014-07-16 广州唯品会网络技术有限公司 Event dispatching method and system
CN104539661A (en) * 2014-12-11 2015-04-22 曙光信息产业(北京)有限公司 Message queue processing method and device
CN105306552A (en) * 2015-09-30 2016-02-03 中国科学院计算技术研究所 Consumption equilibrium method and system based on message queues
CN105721553A (en) * 2016-01-25 2016-06-29 中国联合网络通信有限公司广东省分公司 Self-adaptive cluster message dispatcher
CN106878197A (en) * 2017-02-22 2017-06-20 郑州云海信息技术有限公司 A kind of management system and method for the transmission of cloud platform message
CN106886457A (en) * 2015-12-16 2017-06-23 泰康保险集团股份有限公司 Message queue processing method and processing device
CN107592364A (en) * 2017-09-22 2018-01-16 中汇信息技术(上海)有限公司 A kind of distributed message exchange method and system
CN108134830A (en) * 2017-12-20 2018-06-08 马上消费金融股份有限公司 Load-balancing method, system, device and storage medium based on message queue
CN108848039A (en) * 2018-04-24 2018-11-20 平安科技(深圳)有限公司 The method and storage medium that server, message are distributed
CN109145593A (en) * 2018-07-04 2019-01-04 杭州涂鸦信息技术有限公司 A kind of method, apparatus and computer equipment of Internet of Things net filtration invalid data
CN109976977A (en) * 2019-03-28 2019-07-05 努比亚技术有限公司 Application service loads decompression method, server and storage medium
CN110149392A (en) * 2019-05-17 2019-08-20 优信拍(北京)信息科技有限公司 A kind of management method and device of PUSH message
CN110290217A (en) * 2019-07-01 2019-09-27 腾讯科技(深圳)有限公司 Processing method and processing device, storage medium and the electronic device of request of data
CN111078389A (en) * 2018-10-18 2020-04-28 杭州海康威视数字技术股份有限公司 Junk data cleaning method and device, electronic equipment and readable storage medium
CN111541619A (en) * 2020-04-30 2020-08-14 中国人民银行清算总中心 Self-adaptive active load adjusting method and device of enterprise information networking checking system
CN111782488A (en) * 2020-07-10 2020-10-16 中国工商银行股份有限公司 Message queue monitoring method and device, electronic equipment and medium
CN112612607A (en) * 2020-12-16 2021-04-06 平安消费金融有限公司 Data processing method, device, computer equipment and medium based on message queue
CN113835905A (en) * 2021-09-28 2021-12-24 北京奇艺世纪科技有限公司 Message queue load balancing method and device, electronic equipment and medium
CN115484211A (en) * 2022-09-14 2022-12-16 中国银行股份有限公司 Double-activity processing method and system for size payment system

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101014002A (en) * 2006-12-12 2007-08-08 华为技术有限公司 Cluster message transmitting method and distributed cluster system
CN101753444A (en) * 2009-12-31 2010-06-23 卓望数码技术(深圳)有限公司 Method and device for load balancing
US20100229182A1 (en) * 2009-03-05 2010-09-09 Fujitsu Limited Log information issuing device, log information issuing method, and program

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101014002A (en) * 2006-12-12 2007-08-08 华为技术有限公司 Cluster message transmitting method and distributed cluster system
US20100229182A1 (en) * 2009-03-05 2010-09-09 Fujitsu Limited Log information issuing device, log information issuing method, and program
CN101753444A (en) * 2009-12-31 2010-06-23 卓望数码技术(深圳)有限公司 Method and device for load balancing

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
嵇智辉,倪宏,刘磊: "动态消息队列负载均衡策略的研究与应用", 《计算机工程》, vol. 35, no. 8, 30 April 2009 (2009-04-30) *

Cited By (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103927218B (en) * 2014-04-30 2017-07-04 广州唯品会网络技术有限公司 Event distributing method and system
CN103927218A (en) * 2014-04-30 2014-07-16 广州唯品会网络技术有限公司 Event dispatching method and system
CN104539661A (en) * 2014-12-11 2015-04-22 曙光信息产业(北京)有限公司 Message queue processing method and device
CN105306552A (en) * 2015-09-30 2016-02-03 中国科学院计算技术研究所 Consumption equilibrium method and system based on message queues
CN106886457A (en) * 2015-12-16 2017-06-23 泰康保险集团股份有限公司 Message queue processing method and processing device
CN106886457B (en) * 2015-12-16 2020-09-04 泰康保险集团股份有限公司 Message queue processing method and device
CN105721553A (en) * 2016-01-25 2016-06-29 中国联合网络通信有限公司广东省分公司 Self-adaptive cluster message dispatcher
CN105721553B (en) * 2016-01-25 2019-06-25 中国联合网络通信有限公司广东省分公司 A kind of adaptive cluster message distributor
CN106878197A (en) * 2017-02-22 2017-06-20 郑州云海信息技术有限公司 A kind of management system and method for the transmission of cloud platform message
CN107592364B (en) * 2017-09-22 2020-08-11 中汇信息技术(上海)有限公司 Distributed message exchange method and system
CN107592364A (en) * 2017-09-22 2018-01-16 中汇信息技术(上海)有限公司 A kind of distributed message exchange method and system
CN108134830A (en) * 2017-12-20 2018-06-08 马上消费金融股份有限公司 Load-balancing method, system, device and storage medium based on message queue
CN108848039B (en) * 2018-04-24 2021-11-02 平安科技(深圳)有限公司 Server, message distribution method and storage medium
CN108848039A (en) * 2018-04-24 2018-11-20 平安科技(深圳)有限公司 The method and storage medium that server, message are distributed
CN109145593A (en) * 2018-07-04 2019-01-04 杭州涂鸦信息技术有限公司 A kind of method, apparatus and computer equipment of Internet of Things net filtration invalid data
CN111078389A (en) * 2018-10-18 2020-04-28 杭州海康威视数字技术股份有限公司 Junk data cleaning method and device, electronic equipment and readable storage medium
CN111078389B (en) * 2018-10-18 2023-09-05 杭州海康威视数字技术股份有限公司 Junk data cleaning method and device, electronic equipment and readable storage medium
CN109976977A (en) * 2019-03-28 2019-07-05 努比亚技术有限公司 Application service loads decompression method, server and storage medium
CN110149392A (en) * 2019-05-17 2019-08-20 优信拍(北京)信息科技有限公司 A kind of management method and device of PUSH message
CN110290217A (en) * 2019-07-01 2019-09-27 腾讯科技(深圳)有限公司 Processing method and processing device, storage medium and the electronic device of request of data
CN110290217B (en) * 2019-07-01 2022-04-26 腾讯科技(深圳)有限公司 Data request processing method and device, storage medium and electronic device
CN111541619A (en) * 2020-04-30 2020-08-14 中国人民银行清算总中心 Self-adaptive active load adjusting method and device of enterprise information networking checking system
CN111541619B (en) * 2020-04-30 2023-05-05 中国人民银行清算总中心 Self-adaptive active load adjusting method and device for enterprise information networking checking system
CN111782488A (en) * 2020-07-10 2020-10-16 中国工商银行股份有限公司 Message queue monitoring method and device, electronic equipment and medium
CN111782488B (en) * 2020-07-10 2024-02-02 中国工商银行股份有限公司 Message queue monitoring method, device, electronic equipment and medium
CN112612607A (en) * 2020-12-16 2021-04-06 平安消费金融有限公司 Data processing method, device, computer equipment and medium based on message queue
CN113835905A (en) * 2021-09-28 2021-12-24 北京奇艺世纪科技有限公司 Message queue load balancing method and device, electronic equipment and medium
CN113835905B (en) * 2021-09-28 2023-09-05 北京奇艺世纪科技有限公司 Message queue load balancing method and device, electronic equipment and medium
CN115484211A (en) * 2022-09-14 2022-12-16 中国银行股份有限公司 Double-activity processing method and system for size payment system

Also Published As

Publication number Publication date
CN102457906B (en) 2014-01-08

Similar Documents

Publication Publication Date Title
CN102457906B (en) Load balancing control method and system of message queues
US10887247B2 (en) Dynamic resource allocation for sensor devices on a cellular network
CN102377685B (en) Subscription message sending system and subscription message sending method
CN101909048B (en) Centralized trans-coding treatment method and device
CN105450757A (en) Service management method and system
CN104731663A (en) Task processing method and system
CN111131401B (en) Service request response method and system
CN109766172B (en) Asynchronous task scheduling method and device
CN100562850C (en) Multi-processor load distribution-regulation method
CN109802986B (en) Equipment management method, system, device and server
CN104252390A (en) Resource scheduling method, device and system
US20160344582A1 (en) Call home cluster
CN102724132B (en) Method and device for improving transmission control protocol (TCP) connection multiplexing processing efficiency
CN102521057A (en) Resource scheduling method and device
CN105592127A (en) Application management system for cloud computing environment
CN102902594A (en) Resource management system and resource management method
CN103150241A (en) System and method for monitoring and managing status of multi-server
CN104750544A (en) Process management system and process management method applied to distributed system
CN111459681B (en) Dynamic elastic telescoping method based on micro-service load
CN110290009B (en) Data scheduling method and device and computer readable storage medium
CN109388501B (en) Communication matching method, device, equipment and medium based on face recognition request
CN105338008A (en) Equipment scheduling method, device and system for internet of things
CN112231123A (en) Message processing method, message processing device, storage medium and electronic device
CN102571595A (en) Route forwarding information synchronizing method and device of stack system
KR101272077B1 (en) System and method for providing push service

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant