CN104753817A - Local analogy method and local analogy system for cloud computing message queue service - Google Patents
Local analogy method and local analogy system for cloud computing message queue service Download PDFInfo
- Publication number
- CN104753817A CN104753817A CN201310727064.7A CN201310727064A CN104753817A CN 104753817 A CN104753817 A CN 104753817A CN 201310727064 A CN201310727064 A CN 201310727064A CN 104753817 A CN104753817 A CN 104753817A
- Authority
- CN
- China
- Prior art keywords
- message
- queue
- message queue
- node
- routing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Abstract
The invention discloses a local analogy method and a local analogy system for a cloud computing message queue service. The method comprises the steps that when a message queue creation request is received, a local analogy message queue cluster is created according to the message queue creation request, wherein a message queue of the local analogy message queue cluster comprises a business queue of master message queue nodes and a mirror queue corresponding to the business queue in corresponding slave message queue nodes, and the business queue and the corresponding mirror queue synchronize the data through a heartbeat mechanism; and when a message sent by a producer is received, the message is routed to the corresponding message queue. Through adoption of the method and system, the availability of the local analogy cloud computing message queue is improved.
Description
Technical field
The present invention relates to communication technical field, particularly relate to the local analogy method of a kind of cloud computing Message Queuing Services and system.
Background technology
Cloud computing (cloud computing) is the burning hoter direction of current information technical development, it refers to the increase of the related service based on the Internet, use and delivery mode, is usually directed to provide dynamically easily expansion by the Internet and is often virtualized resource.Cloud computing is mainly divided into three levels: namely infrastructure serve (IaaS), and namely platform serves (PaaS) and namely software serve (SaaS).PaaS(Platform-as-a-Service, namely platform serves) in fact refer to the platform of research and development of software as one service, and be supplied to developer's use open for various Service Source, reasonable fee is carried out to the resource used, and trustship O&M is carried out to the application program of exploitation.
Message queue essence is the chained list of a message.Message can be regarded as a record, there is specific form and specific priority.There is the process of write permission in message queue, new information can be added according to certain rule to message queue; There is the process of read right then can read away message from message queue to message queue.
Message Queuing Services is the Distributed Message Queue service that cloud computing PaaS platform provides for developer, be used for asynchronism and concurrency perform efficiently user submit to HTTP(Hyper Text Transport Protocol, HTML (Hypertext Markup Language)) request task.Traditional sending in HTTP request to multiple user is that serial performs, and a message is sent and just can sends next message, and this mode affects the operating efficiency of overall task.After employing Message Queuing Services, the task of each transmission HTTP request can be put into queue, then the mode of these tasks namely with asynchronism and concurrency after adding queue performs on backstage, total duration is that task puts into Queue time and task execution time sum, as long as the concurrency of queue tasks carrying is enough large, each task execution time can be considered the time of implementation of parallel task, and this mode substantially increases the operating efficiency of overall task.
The one service that Message Queuing Services externally can provide as cloud computing PaaS platform, developer can apply for the service using high in the clouds message queue cluster to provide when exploitation high in the clouds application program, comprise establishment queue, interpolation individual task, batch interpolation task, task is pushed the operations such as queue, acquisition queue residue length, release queue, closedown Message Queuing Services.
Exploitation debugging mainly adopts following two kinds of modes based on using the application program of high in the clouds Message Queuing Services:
1), based on this locality exploitation engine unifying Integrated Development Tool has developed after APD is deployed to high in the clouds runtime engine, and by checking high in the clouds running log, carry out debugging the program code using high in the clouds Message Queuing Services, its schematic diagram can see Fig. 1.
But the necessary real-time interconnection of application program of this mode development person exploitation, only have and the program code of oneself packing is uploaded to runtime engine, and runtime engine web door solicitation message queue service beyond the clouds, just can check that program uses the log(daily record of Message Queuing Services), and if program code does not call API(Application Programming Interface in time, application programming interfaces) method discharges in time to the message queue do not re-used, and can cause the waste of high in the clouds Message Queuing resource.
2) message queue (MessageQueuing of high in the clouds Message Queuing Services, can be simulated local pre-installation one, MQ), the application program of such use high in the clouds Message Queuing Services just changes the application program calling local message queue into, facilitate developer under the condition of not networking, also can debug the high in the clouds application program of oneself like this, and avoid because use Message Queuing Services lack of standardization in program causes the waste problem of high in the clouds Message Queuing resource.Its schematic diagram can see Fig. 2.
This pattern does not consider that centralized message queue easily becomes bottleneck when extensive application program uses, standalone message queue service cannot meet a large amount of concurrent request of user, and there is no back mechanism, after Single Point of Faliure appears in centralized message queue, the loss of data in message queue can be caused.
Summary of the invention
The invention provides the local analogy method of a kind of cloud computing Message Queuing Services and system, in order to improve the availability of the cloud computing message queue of this simulation.
In order to reach above object, embodiments providing the local analogy method of a kind of cloud computing Message Queuing Services, comprising:
When receipt message queue request to create, create this simulation message queue cluster according to described queue request to create; Wherein, the message queue in described simulation message queue cluster comprises the service queue in main message queue node, and correspondence from message queue node to should the mirror image queue of service queue; Described service queue realizes data syn-chronization with corresponding mirror image queue by heartbeat mechanism;
When receiving the message that the producer sends, by described Message routing to corresponding message queue.
The embodiment of the present invention additionally provides the local analogue system of a kind of cloud computing Message Queuing Services,
Comprise:
Queue creating unit, when receiving message queue request to create, creates this simulation message queue cluster according to described queue request to create; Wherein, the message queue in described simulation message queue cluster comprises the service queue in main message queue node, and correspondence from message queue node to should the mirror image queue of service queue; Described service queue realizes data syn-chronization with corresponding mirror image queue by heartbeat mechanism;
Routing unit, for when receiving the message that the producer sends, by described Message routing to corresponding message queue.
In the above embodiment of the present invention, when creating this simulation message queue cluster, adopt the framework of principal and subordinate's message queue node, service queue is created in main message queue node, and from message queue node, create mirror image queue corresponding to this service queue in correspondence, the two forms the master/slave mirror image queue cluster of leader follower replication, two-way backup jointly, improves the availability of the cloud computing message queue of this simulation.
Accompanying drawing explanation
Fig. 1 is a kind of schematic diagram developing the application program of debugging based on use high in the clouds Message Queuing Services of the prior art;
Fig. 2 is the schematic diagram of another kind exploitation debugging of the prior art based on the application program of use high in the clouds Message Queuing Services;
The schematic flow sheet of the local analogy method of a kind of cloud computing Message Queuing Services that Fig. 3 provides for the embodiment of the present invention;
The Organization Chart of the local analogue system of a kind of cloud computing Message Queuing Services that Fig. 4 provides for the embodiment of the present invention;
The schematic diagram of a kind of message transmitting confirmation mechanism that Fig. 5 provides for the embodiment of the present invention;
The schematic diagram of the method that Fig. 6 supports for this simulation message queue that the embodiment of the present invention provides;
The structural representation of the local analogue system of a kind of cloud computing Message Queuing Services that Fig. 7 provides for the embodiment of the present invention.
Embodiment
For the technical problem existed in above-mentioned prior art, embodiments provide a kind of technical scheme of this simulation of cloud computing Message Queuing Services.In this technical scheme, when receiving message queue request to create, create this simulation message queue cluster according to described queue request to create; Wherein, the message queue of this this simulation message queue cluster comprises the service queue in main message queue node, and correspondence from message queue node to should the mirror image queue of service queue; This service queue realizes data syn-chronization with corresponding mirror image queue by heartbeat mechanism; When receiving the message that the producer sends, by this Message routing to corresponding message queue.
In embodiments of the present invention, when creating this simulation message queue cluster, adopt the framework of principal and subordinate's message queue node, service queue is created in main message queue node, and from message queue node, create mirror image queue corresponding to this service queue in correspondence, the two forms the master/slave mirror image queue cluster of leader follower replication, two-way backup jointly, improves the availability of the cloud computing message queue of this simulation.
Below in conjunction with the accompanying drawing in the application, carry out clear, complete description to the technical scheme in the application, obviously, described embodiment is a part of embodiment of the application, instead of whole embodiments.Based on the embodiment in the application, the every other embodiment that those of ordinary skill in the art obtain under the prerequisite not making creative work, all belongs to the scope of the application's protection.
As shown in Figure 3, be the schematic flow sheet of the local analogy method of a kind of cloud computing Message Queuing Services that the embodiment of the present invention provides, can comprise the following steps:
Step 301, when receipt message queue request to create, create this simulation message queue cluster according to this queue request to create; Wherein, the message queue in this simulation message queue cluster comprises the service queue in main message queue node, and correspondence from message queue node to should the mirror image queue of service queue; Service queue realizes data syn-chronization with corresponding mirror image queue by heartbeat mechanism.
Concrete, in order to improve the availability of this simulation message queue cluster, in embodiments of the present invention, when creating message queue, adopting the framework of principal and subordinate's message queue node, in main message queue node, creating service queue, and from message queue node, create mirror image queue corresponding to this service queue in correspondence, service queue and mirror image queue provide service jointly, achieve sharing of load, can successfully manage the concurrent request that user is a large amount of; Meanwhile, two-way backup therebetween, efficiently avoid the loss of the data in the message queue caused due to Single Point of Faliure.
Wherein, when main message queue nodes break down, what this main message queue node was corresponding is converted to main message queue node from message queue node, is converted to service queue from the mirror image queue message queue node; When the main message queue node broken down recovers, this main message queue node is converted to from message queue node, and the service queue in this main message queue node is converted to mirror image queue.
Step 302, when receive the producer send message time, by this Message routing to correspondence message queue.
Concrete, in embodiments of the present invention, when creating this simulation message queue cluster, between the message queue created and the switch of correspondence, set up the binding of link, and preserve switch name, message queue title, and bindingkey(bind pathname) corresponding relation.
The producer, when sending message, needs to carry switch name and routingkey(route major key within the message).
Correspondingly, when receiving the message that the producer sends, this message can be transmitted to corresponding switch according to the switch name of carrying in message, so by this switch according to the routingkey carried in this message by the message queue of this Message routing to correspondence.
Wherein, switch can inquire about according to the routingkey carried in message the corresponding relation (switch name, the message queue title that self store, and the corresponding relation of bindingkey), when comprising the bindingkey mated with this routingkey in the corresponding relation that self stores, by this Message routing to message queue corresponding to this bindingkey.
In order to realize load balancing further, in embodiments of the present invention, when needing to route messages in corresponding message queue, first can judge whether the major queue of the message queue that this message is corresponding is in overload status; If be judged as YES, then by the mirror image queue of this Message routing to corresponding message queue; Otherwise, by the service queue of this Message routing to corresponding message queue.
Wherein, message queue is in overload status and specifically can comprises:
The actual linking number of message queue is greater than default maximum number of connections; Or/and,
The response time of message queue is greater than default time threshold.
In order to improve the fail safe of data in message queue further, avoid Single Point of Faliure to cause loss of data in message queue, in embodiments of the present invention, this simulation message queue cluster is provided with persistence function; When the producer sends message, need in this message to carry persistence property parameters.
Correspondingly, switch and message queue are persistence attribute, to ensure that the binding between switch and message queue is persistence.
In order to improve the fail safe of data in message queue further, prevent disabled user from reading data in message queue, in embodiments of the present invention, the producer is when sending message, and the message of the message queue double secret key transmission needing usage platform to distribute is encrypted; Correspondingly, when receiving the access request to the message in message queue, need to verify (determining whether this key can decipher the message of the encryption of institute's request access) the key carried in access request, and when being verified (this key can decipher the information of the encryption of institute's request access), allow to conduct interviews to this message.
Further, in embodiments of the present invention, when receiving message queue state and checking request, the state of corresponding message queue can be shown by web interface; Wherein, the state of this message queue can comprise the quantity of message in the number of message queue, title and each message queue.
In order to understand the technical scheme that the embodiment of the present invention provides better, below in conjunction with concrete application scenarios, the technical scheme that the embodiment of the present invention provides is further described in more detail.
In this embodiment, the Organization Chart of the local analogue system of cloud computing Message Queuing Services can be as shown in Figure 4, mainly comprise high in the clouds runtime engine message queue, local exploitation engine, this simulation message queue node cluster, this high in the clouds runtime engine message queue is developed engine by the Internet and this locality and is connected, and this local message queue node cluster can be built in this locality by developer.Wherein:
High in the clouds runtime engine Message Queuing Services is the target message queue of this simulation, it provides Distributed Message Queue service for developer, the data that can transmit between the process of different computer node, realize the HTTP request task that asynchronism and concurrency performs user's submission efficiently simultaneously.User can use Message Queuing Services by API, can return immediately after the sender (i.e. the producer) of message sends a message to message queue, without the response of wait-receiving mode person (i.e. consumer), message can be stored in queue, until recipient takes out it, this asynchronous mode can improve the efficiency of system.And sender is without the need to directly connecting with recipient, and by message queue, both sides ensure that message can be routed to recipient from sender, complete and indirectly connect.
The unified Integrated Development Tool that local exploitation engine modules provides for developer, it is integrated with the message queue cluster SDK(Software Development Kit using this simulation, SDK), the functions such as queue, interpolation individual task, batch interpolation task, query request length can be created by it.
Local message queue node cluster comprises High Availabitity mirror image queue cluster and load balancing HAProxy.Wherein:
Mirror image queue cluster, be used for receive the producer send message and by these Message routing to the message queue in server.In this embodiment, switch Exchange is adopted to be Direct type route pattern.Node B can as node A from message queue node, in Node B create have the mirror image queue that the service queue of node A is corresponding, both form the master/slave mirror image queue cluster of leader follower replication, two-way backup jointly.The mirror image queue mirror queue of node A can be created in Node B, and by arranging identical cookie, when there being data variation in the message queue having node, monitored by the heartbeat mechanism of node and there is the message queue of identical cookie, and then finishing service queue and data in mirror image queue is synchronous.When master node A delays machine, slave Node B can transfer master to immediately, after node A repairs, Node B can synchrodata to node A, now node A becomes slave node, and B becomes new master node.Meanwhile, main message queue node can be increased according to service needed and from message queue node.
Wherein, above-mentioned switch Exchange is that Direct type route pattern refers to, the producer is when sending message, need for message specifies a routingkey and concrete switch Exchange, the binding of setting up link is needed between Exchange and the queue of establishment, by switch name ExchangeName, message queue title QueueName, binding pathname bindingkey three binds, the routingkey of meeting comparison message and the bindingkey in existing binding path after Exchange receives message, can message be sent in the message queue that bindingkey specifies after coupling, complete message to send, the function of routing forwarding.
Load balancing HAProxy is responsible for the load balancing of each message queue node, the message transfers producer sent is to the lower message queue node of load, take over the task that the producer's monitoring sending message is maintained into the connection of each message queue node simultaneously, prevented because the producer disconnects to the connection of message queue node and send the situation of message failure.
Based on the system architecture shown in Fig. 4, the local analogy method of the cloud computing Message Queuing Services that the embodiment of the present invention provides can comprise:
When developer is based on unified Integrated Development Tool (IDE) development sequence, first opens local message queue service, build message queue cluster according to service needed.The configuration of acquiescence is node A is main message queue node, and for creating concrete service queue QueueA and QueueB, Node B is from message queue node, for creating mirror image queue MirrorQueueA and the MirrorQueueB of business.Configuration messages queue nodes cookie is identical value.At node A, Node B is added in cluster cluster, in message queue cluster, each node carries out heartbeat monitor according to identical cookie, mirror image queue strategy is set in node A, acquiescence be with " ha. " start title queue can in the cluster other nodes create a mirror image queue MirrorQueue.
Build load balancing HAProxy for completing the load balancing of High Availabitity message queue node.Maximum number of connections maxconn and time-out time timeout can be set herein, namely when the actual linking number of node is greater than maximum number of connections, or/and, when the response time of node exceedes time-out time, think this node overload.Load balancing adopts roundrobin(poll), each server uses in turn according to weight, if the processing time of server is evenly distributed, this is smooth and the most fair algorithm.Algorithm is dynamic, and the weight starting slow server for example can be in operation adjustment.Configuration monitoring message queue address of node and port simultaneously.
Before the producer sends message, the function of message queue cluster persistence is set, avoids Single Point of Faliure to cause message data in queue to lose.The persistence property parameters MessageProperties.PERSISTENT_TEXT_PLAIN that message is set is needed when sending message, arrange switch exchange and queue queue is persistence attribute, this arranges and ensures that the binding between them is also persistence simultaneously.For meeting reliability, ensureing that recipient only receives message and deletes former message again, needing here to increase switch exchange and sender, and the ack affirmation mechanism of queue and consumer consumer, ensure the transmitting of message.When connecting generation and being abnormal, need to resend message, its schematic diagram can be as shown in Figure 5.
When sending message, needing to fill in platform is the message queue key accesskey that developer distributes, the message of all transmissions uses accesskey to encrypt in advance, and service logic needs accesskey to access concrete message queue, only has real user could use own message queue.This mechanism has ensured that the message content of each business is safe storage, and other business can not have access to the data of non-self business.
Last when not using Message Queuing Services, need to close message queue, prevent from taking waste system resource.
In this embodiment, the host node of message queue, form master/slave master-slave back-up High Availabitity model from node, when the machine of delaying appears in host node master, can change master immediately into from node slave externally provides Message Queuing Services.Repair the complete message queue cluster that rejoins when original host node and can change new slave node into, again form master/slave master-slave back-up model.
Transmission message, receipt message only need be tied to concrete service queue title, mirror image queue mechanism can create mirror image queue mirror queue automatically from node, the machine even if host node is delayed, also without the need to message queue title in change program, all queued name's maintenance works are transparent to developer.
In this embodiment, exploitation engine is unified Integrated Development Tool and is called this simulation Message Queuing Services by integrated message queue SDK, the method supported mainly contains functions such as creating queue, interpolation individual task, batch interpolation task, query request length, and main support method is shown in Figure 6:
1, developer initiates by unified Integrated Development Tool the request using local message queue service, call TaskQueue (appid) constructed fuction and create message queue, appid is application id, and platform can carry out to user's application the legitimacy certification using message queue according to appid.
2, developer can call TaskQueue.addTask (task, accesskey, appid) individual task is added, wherein task is specific tasks image parameter, accesskey is the key of access message queue, and whether platform can have permission according to accesskey checking application is added task task in queue.If application is directly by http protocol access message queue, then message has to pass through base64 coding, the message sink mistake that the coded format confusion that this avoid message causes.This SDK method bottom has done base64 code conversion to message.
3, developer can call TaskQueue.addTask (tasklist, accesskey, appid) batch adds task, wherein tasklist is batch tasks image parameter, developer can relevant task task put into tasklist set, once to message queue batch add task.
4, developer can call TaskQueue.getLeftLength (tasklist, accesskey, appid) and obtain queue residue length, and wherein tasklist is batch tasks image parameter.
5, developer can call TaskQueue.recv (accesskey, appid) and read message from the message queue created.
6, developer can call the Message Queuing resource that TaskQueue.release (accesskey, appid) discharges oneself establishment.
7, developer can check the state of message queue by local web interface, comprises node and has message number etc. in message queue number, title, each queue.
Wherein, above-mentioned appid is application id, and when developer is by runtime engine platform portal application for registration developing application, platform can be each application assigned appid, for this application program of unique identification.
Above-mentioned accesskey is the key of user's access message queue service, user tries out Message Queuing Services by the application of runtime engine platform portal, platform can distribute the key accesskey of access message queue service for developer, in order to carry out legitimacy certification to developer, and message is encrypted, prevent rogue program from stealing information resources in other application message queues.
Above-mentioned base64 coding, when using SDK can pass any message to message queue based on http protocol application, because message is the byte stream through serializing, does not belong to http agreement specified standard code character, so need to carry out base64 coding.Message queue SDK method bottom encapsulates base64 coding and realizes, and developer does not worry Confused-code, can transmit any message content to SDK interface.
By describing above and can finding out, in the technical scheme that the embodiment of the present invention provides, avoid the application program of developer's necessary real-time interconnection ability debugging operations high in the clouds Message Queuing Services, avoid because use Message Queuing Services lack of standardization in program causes high in the clouds message queue data to make the problem of malicious attack, simultaneously also can full simulation high in the clouds message queue high availability feature, avoid Single Point of Faliure, possess message queue persistence characteristic.
Based on identical technical conceive, the embodiment of the present invention additionally provides the local analogue system of a kind of cloud computing Message Queuing Services, can be applied to said method embodiment.
As shown in Figure 7, be the structural representation of the local analogue system of a kind of cloud computing Message Queuing Services that the embodiment of the present invention provides, can comprise:
Queue creating unit 71, when receiving message queue request to create, creates this simulation message queue cluster according to described queue request to create; Wherein, the message queue in described simulation message queue cluster comprises the service queue in main message queue node, and correspondence from message queue node to should the mirror image queue of service queue; Described service queue realizes data syn-chronization with corresponding mirror image queue by heartbeat mechanism;
Routing unit 72, for when receiving the message that the producer sends, by described Message routing to corresponding message queue.
Wherein, described routing unit 72 specifically comprises: forward subelement and switch subelement;
Described forwarding subelement 721, for being transmitted to corresponding switch according to the switch name of carrying in described message by described message;
Described switch subelement 722, for according to the route major key routingkey carried in described message by described Message routing to corresponding message queue.
Wherein, described queue creating unit 71 specifically for, when creating this simulation message queue cluster, between the message queue created and the switch of correspondence, set up the binding of link, and preserve switch name, message queue title, and the corresponding relation of binding pathname bindingkey;
Described switch subelement 722 specifically for, the corresponding relation self stored is inquired about according to described routingkey, when comprising the bindingkey mated with this routingkey in described corresponding relation, by described Message routing to message queue corresponding to this bindingkey.
Wherein, described routing unit 72 specifically comprises:
Load balancing subelement 723, for judging whether the service queue of the message queue that described message is corresponding is in overload status, if be judged as YES, then by described Message routing to the mirror image queue in the message queue of correspondence; Otherwise, by described Message routing to the service queue in the message queue of correspondence.
Wherein, message queue is in overload status and specifically comprises:
The actual linking number of message queue is greater than default maximum number of connections; Or/and,
The response time of message queue is greater than default time threshold.
Wherein, the message that the described producer sends is the message after the message queue secret key encryption that described producer's usage platform distributes;
The local analogue system of the cloud computing Message Queuing Services that the embodiment of the present invention provides also comprises:
Authentication unit 73, for when the local analogue system of described cloud computing Message Queuing Services receives the access request to described message, verifies the key carried in described access request, and when being verified, allows the access to described message.
Wherein, the local analogue system of cloud computing Message Queuing Services that the embodiment of the present invention provides also comprises:
Display unit 74, for when receiving message queue state and checking request, shows the state of corresponding message queue by web interface.
Wherein, the state of described message queue comprises: the quantity of message in the number of message queue, title and each message queue.
Wherein, when main message queue nodes break down, be describedly converted to main message queue node from message queue node, be describedly converted to service queue from the mirror image queue message queue node;
When the described main message queue node broken down recovers, described main message queue node is converted to from message queue node, and the service queue in described main message queue node is converted to mirror image queue.
Through the above description of the embodiments, those skilled in the art can be well understood to the mode that the present invention can add required general hardware platform by software and realize, and can certainly pass through hardware, but in a lot of situation, the former is better execution mode.Based on such understanding, technical scheme of the present invention can embody with the form of software product the part that prior art contributes in essence in other words, this computer software product is stored in a storage medium, comprising some instructions in order to make a station terminal equipment (can be mobile phone, personal computer, server, or the network equipment etc.) perform method described in each embodiment of the present invention.
The above is only the preferred embodiment of the present invention; it should be pointed out that for those skilled in the art, under the premise without departing from the principles of the invention; can also make some improvements and modifications, these improvements and modifications also should look protection scope of the present invention.
Claims (17)
1. the local analogy method of cloud computing Message Queuing Services, is characterized in that, comprising:
When receipt message queue request to create, create this simulation message queue cluster according to described queue request to create; Wherein, the message queue in described simulation message queue cluster comprises the service queue in main message queue node, and correspondence from message queue node to should the mirror image queue of service queue; Described service queue realizes data syn-chronization with corresponding mirror image queue by heartbeat mechanism;
When receiving the message that the producer sends, by described Message routing to corresponding message queue.
2. the method for claim 1, is characterized in that, described by described Message routing to described message queue, be specially:
Described message is transmitted to corresponding switch according to the switch name of carrying in described message, by described switch according to the route major key routingkey carried in described message by the message queue of described Message routing to correspondence.
3. method as claimed in claim 2, it is characterized in that, when creating this simulation message queue cluster, the binding of link is set up between the message queue created and the switch of correspondence, and preserve switch name, message queue title, and the corresponding relation of binding pathname bindingkey;
Described switch, is specially the message queue of described Message routing to correspondence according to the route major key routingkey carried in described message:
Described switch inquires about the corresponding relation self stored according to described routingkey, when comprising the bindingkey mated with this routingkey in described corresponding relation, by described Message routing to message queue corresponding to this bindingkey.
4. the method for claim 1, is characterized in that, described by the message queue of described Message routing to correspondence, is specially:
Judge whether the service queue of the message queue that described message is corresponding is in overload status, if be judged as YES, then by described Message routing to the mirror image queue in the message queue of correspondence; Otherwise, by described Message routing to the service queue in the message queue of correspondence.
5. method as claimed in claim 4, it is characterized in that, message queue is in overload status and specifically comprises:
The actual linking number of message queue is greater than default maximum number of connections; Or/and,
The response time of message queue is greater than default time threshold.
6. method as claimed in claim 2, it is characterized in that, described simulation message queue cluster is provided with persistence function; Described switch and described message queue are persistence attribute; Persistence property parameters is carried in described message.
7. the method for claim 1, is characterized in that, the message that the described producer sends is the message after the message queue secret key encryption that described producer's usage platform distributes;
The method also comprises:
When receiving the access request to described message, the key carried in described access request is verified, and when being verified, allow the access to described message.
8. the method for claim 1, is characterized in that, the method also comprises:
When receiving message queue state and checking request, shown the state of corresponding message queue by web interface.
9. method as claimed in claim 8, it is characterized in that, the state of described message queue comprises: the quantity of message in the number of message queue, title and each message queue.
10. the method for claim 1, is characterized in that, when main message queue nodes break down, is describedly converted to main message queue node from message queue node, is describedly converted to service queue from the mirror image queue message queue node;
When the described main message queue node broken down recovers, described main message queue node is converted to from message queue node, and the service queue in described main message queue node is converted to mirror image queue.
11. 1 kinds of local analogue systems of cloud computing Message Queuing Services, is characterized in that, comprising:
Queue creating unit, when receiving message queue request to create, creates this simulation message queue cluster according to described queue request to create; Wherein, the message queue in described simulation message queue cluster comprises the service queue in main message queue node, and correspondence from message queue node to should the mirror image queue of service queue; Described service queue realizes data syn-chronization with corresponding mirror image queue by heartbeat mechanism;
Routing unit, for when receiving the message that the producer sends, by described Message routing to corresponding message queue.
The local analogue system of 12. cloud computing Message Queuing Services as claimed in claim 11, it is characterized in that, described routing unit specifically comprises: forward subelement and switch subelement;
Described forwarding subelement, for being transmitted to corresponding switch according to the switch name of carrying in described message by described message;
Described switch subelement, for according to the route major key routingkey carried in described message by described Message routing to corresponding message queue.
The local analogue system of 13. cloud computing Message Queuing Services as claimed in claim 12, is characterized in that,
Described queue creating unit specifically for, when creating this simulation message queue cluster, between the message queue created and the switch of correspondence, set up the binding of link, and preserve switch name, message queue title, and the corresponding relation of binding pathname bindingkey;
Described switch subelement specifically for, the corresponding relation self stored is inquired about according to described routingkey, when comprising the bindingkey mated with this routingkey in described corresponding relation, by described Message routing to message queue corresponding to this bindingkey.
The local analogue system of 14. cloud computing Message Queuing Services as claimed in claim 11, it is characterized in that, described routing unit specifically comprises:
Load balancing subelement, for judging whether the service queue of the message queue that described message is corresponding is in overload status, if be judged as YES, then by described Message routing to the mirror image queue in the message queue of correspondence; Otherwise, by described Message routing to the service queue in the message queue of correspondence.
The local analogue system of 15. cloud computing Message Queuing Services as claimed in claim 11, it is characterized in that, message queue is in overload status and specifically comprises:
The actual linking number of message queue is greater than default maximum number of connections; Or/and,
The response time of message queue is greater than default time threshold.
The local analogue system of 16. cloud computing Message Queuing Services as claimed in claim 11, is characterized in that, the message that the described producer sends is the message after the message queue secret key encryption that described producer's usage platform distributes;
The local analogue system of described cloud computing Message Queuing Services also comprises:
Authentication unit, for when the local analogue system of described cloud computing Message Queuing Services receives the access request to described message, verifies the key carried in described access request, and when being verified, allows the access to described message.
The local analogue system of 17. cloud computing Message Queuing Services as claimed in claim 11, is characterized in that, also comprise:
Display unit, for when receiving message queue state and checking request, shows the state of corresponding message queue by web interface.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310727064.7A CN104753817B (en) | 2013-12-25 | 2013-12-25 | A kind of cloud computing Message Queuing Services local analogy method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310727064.7A CN104753817B (en) | 2013-12-25 | 2013-12-25 | A kind of cloud computing Message Queuing Services local analogy method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104753817A true CN104753817A (en) | 2015-07-01 |
| CN104753817B CN104753817B (en) | 2019-02-05 |
Family
ID=53592946
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310727064.7A Active CN104753817B (en) | 2013-12-25 | 2013-12-25 | A kind of cloud computing Message Queuing Services local analogy method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104753817B (en) |
Cited By (26)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105357296A (en) * | 2015-10-30 | 2016-02-24 | 河海大学 | Elastic caching system based on Docker cloud platform |
| CN106375419A (en) * | 2016-08-31 | 2017-02-01 | 东软集团股份有限公司 | Deployment method and device of distributed cluster |
| CN106878473A (en) * | 2017-04-20 | 2017-06-20 | 腾讯科技（深圳）有限公司 | A kind of message treatment method, server cluster and system |
| CN106878197A (en) * | 2017-02-22 | 2017-06-20 | 郑州云海信息技术有限公司 | A kind of management system and method for the transmission of cloud platform message |
| CN107197015A (en) * | 2017-05-23 | 2017-09-22 | 阿里巴巴集团控股有限公司 | A kind of message treatment method and device based on Message Queuing system |
| CN107315641A (en) * | 2017-05-27 | 2017-11-03 | 杭州铭师堂教育科技发展有限公司 | Message queue high-availability system and method based on Qconf |
| CN107450999A (en) * | 2017-08-07 | 2017-12-08 | 郑州云海信息技术有限公司 | A kind of method and system of cluster inter-component communication |
| CN108173892A (en) * | 2016-12-07 | 2018-06-15 | 腾讯科技（深圳）有限公司 | High in the clouds mirror image operation method and device |
| CN108494880A (en) * | 2018-04-18 | 2018-09-04 | 云家园网络技术有限公司 | Communication means based on large-scale data centre management and system |
| CN108933824A (en) * | 2018-06-28 | 2018-12-04 | 郑州云海信息技术有限公司 | A kind of method, system and relevant apparatus keeping RabbitMQ service |
| CN109766195A (en) * | 2018-12-13 | 2019-05-17 | 平安普惠企业管理有限公司 | The method and Related product of loss of data in supervisory messages queue |
| CN110062055A (en) * | 2019-05-31 | 2019-07-26 | 四川长虹电器股份有限公司 | The method of distributed push is logged in single user based on websocket more |
| CN110225133A (en) * | 2019-06-20 | 2019-09-10 | 恒生电子股份有限公司 | Message method, node, device, system and relevant device |
| CN110442447A (en) * | 2019-07-05 | 2019-11-12 | 中国平安人寿保险股份有限公司 | Load-balancing method, device and computer equipment based on message queue |
| CN110768873A (en) * | 2019-10-31 | 2020-02-07 | 广州酷旅旅行社有限公司 | Distributed heartbeat detection method, system and device and computer equipment |
| CN110891032A (en) * | 2019-11-27 | 2020-03-17 | 佛山市蠢材科技有限公司 | Face data parallel issuing method and device and electronic equipment |
| CN111212100A (en) * | 2018-11-22 | 2020-05-29 | 财团法人工业技术研究院 | Synchronization method and system for publishing and subscribing message queue |
| CN111222862A (en) * | 2018-11-27 | 2020-06-02 | 北京京东金融科技控股有限公司 | Data processing method and system, medium and computer system |
| CN111314114A (en) * | 2020-01-19 | 2020-06-19 | 苏州浪潮智能科技有限公司 | Deployment method and system for improving high availability of RabbitMQ |
| CN111787058A (en) * | 2020-05-26 | 2020-10-16 | 北京航空航天大学 | Lightweight information subscription and push method in cross-domain virtual data space |
| CN111897656A (en) * | 2020-08-06 | 2020-11-06 | 北京中电兴发科技有限公司 | Main queue load balancing method based on mirror image queue |
| CN112738156A (en) * | 2020-12-11 | 2021-04-30 | 广东电力通信科技有限公司 | Independent mirror image management method suitable for intelligent gateway |
| CN114095280A (en) * | 2022-01-20 | 2022-02-25 | 苏州浪潮智能科技有限公司 | Cloud platform server communication channel construction method, communication method, device and server |
| CN115097941A (en) * | 2022-07-13 | 2022-09-23 | 北京百度网讯科技有限公司 | Human interaction detection method, human interaction detection device, human interaction detection equipment and storage medium |
| CN115150031A (en) * | 2022-06-20 | 2022-10-04 | 中国工商银行股份有限公司 | Distributed system message response method and device based on distributed messages |
| CN115280740A (en) * | 2020-01-14 | 2022-11-01 | 第一资本服务有限责任公司 | Techniques for providing streaming data resiliency using a distributed message queue system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101014002A (en) * | 2006-12-12 | 2007-08-08 | 华为技术有限公司 | Cluster message transmitting method and distributed cluster system |
| US20120106545A1 (en) * | 2009-07-24 | 2012-05-03 | Zte Corporation | Main/standby switching interface module, network element system, and link information synchronization detection method |
| CN103049317A (en) * | 2013-01-10 | 2013-04-17 | 中国南方电网有限责任公司超高压输电公司 | Highly-concurrent data fast write system and method based on queues in cloud environment |
| CN103051521A (en) * | 2013-01-09 | 2013-04-17 | 浪潮电子信息产业股份有限公司 | Retransmitting method of message in cloud environment |
| CN103078893A (en) * | 2011-10-25 | 2013-05-01 | 中华电信股份有限公司 | Control and management device and control and management backup system applied to cloud computing |
-
2013
- 2013-12-25 CN CN201310727064.7A patent/CN104753817B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101014002A (en) * | 2006-12-12 | 2007-08-08 | 华为技术有限公司 | Cluster message transmitting method and distributed cluster system |
| US20120106545A1 (en) * | 2009-07-24 | 2012-05-03 | Zte Corporation | Main/standby switching interface module, network element system, and link information synchronization detection method |
| CN103078893A (en) * | 2011-10-25 | 2013-05-01 | 中华电信股份有限公司 | Control and management device and control and management backup system applied to cloud computing |
| CN103051521A (en) * | 2013-01-09 | 2013-04-17 | 浪潮电子信息产业股份有限公司 | Retransmitting method of message in cloud environment |
| CN103049317A (en) * | 2013-01-10 | 2013-04-17 | 中国南方电网有限责任公司超高压输电公司 | Highly-concurrent data fast write system and method based on queues in cloud environment |
Cited By (40)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105357296B (en) * | 2015-10-30 | 2018-10-23 | 河海大学 | Elastic caching system under a kind of Docker cloud platforms |
| CN105357296A (en) * | 2015-10-30 | 2016-02-24 | 河海大学 | Elastic caching system based on Docker cloud platform |
| CN106375419A (en) * | 2016-08-31 | 2017-02-01 | 东软集团股份有限公司 | Deployment method and device of distributed cluster |
| CN108173892B (en) * | 2016-12-07 | 2020-11-13 | 腾讯科技（深圳）有限公司 | Cloud mirror image operation method and device |
| CN108173892A (en) * | 2016-12-07 | 2018-06-15 | 腾讯科技（深圳）有限公司 | High in the clouds mirror image operation method and device |
| CN106878197A (en) * | 2017-02-22 | 2017-06-20 | 郑州云海信息技术有限公司 | A kind of management system and method for the transmission of cloud platform message |
| CN106878473A (en) * | 2017-04-20 | 2017-06-20 | 腾讯科技（深圳）有限公司 | A kind of message treatment method, server cluster and system |
| CN106878473B (en) * | 2017-04-20 | 2021-03-30 | 腾讯科技（深圳）有限公司 | Message processing method, server cluster and system |
| CN107197015A (en) * | 2017-05-23 | 2017-09-22 | 阿里巴巴集团控股有限公司 | A kind of message treatment method and device based on Message Queuing system |
| CN107315641A (en) * | 2017-05-27 | 2017-11-03 | 杭州铭师堂教育科技发展有限公司 | Message queue high-availability system and method based on Qconf |
| CN107315641B (en) * | 2017-05-27 | 2018-08-14 | 杭州铭师堂教育科技发展有限公司 | Message queue high-availability system based on Qconf and method |
| CN107450999A (en) * | 2017-08-07 | 2017-12-08 | 郑州云海信息技术有限公司 | A kind of method and system of cluster inter-component communication |
| CN108494880A (en) * | 2018-04-18 | 2018-09-04 | 云家园网络技术有限公司 | Communication means based on large-scale data centre management and system |
| CN108933824A (en) * | 2018-06-28 | 2018-12-04 | 郑州云海信息技术有限公司 | A kind of method, system and relevant apparatus keeping RabbitMQ service |
| CN111212100B (en) * | 2018-11-22 | 2022-07-19 | 财团法人工业技术研究院 | Synchronization method and system for publishing and subscribing message queue |
| CN111212100A (en) * | 2018-11-22 | 2020-05-29 | 财团法人工业技术研究院 | Synchronization method and system for publishing and subscribing message queue |
| CN111222862A (en) * | 2018-11-27 | 2020-06-02 | 北京京东金融科技控股有限公司 | Data processing method and system, medium and computer system |
| CN109766195A (en) * | 2018-12-13 | 2019-05-17 | 平安普惠企业管理有限公司 | The method and Related product of loss of data in supervisory messages queue |
| CN110062055A (en) * | 2019-05-31 | 2019-07-26 | 四川长虹电器股份有限公司 | The method of distributed push is logged in single user based on websocket more |
| CN110062055B (en) * | 2019-05-31 | 2021-07-20 | 四川长虹电器股份有限公司 | Websocket-based single-user multi-place login distributed push method |
| CN110225133A (en) * | 2019-06-20 | 2019-09-10 | 恒生电子股份有限公司 | Message method, node, device, system and relevant device |
| CN110225133B (en) * | 2019-06-20 | 2022-01-21 | 恒生电子股份有限公司 | Message sending method, node, device, system and related equipment |
| CN110442447B (en) * | 2019-07-05 | 2023-07-28 | 中国平安人寿保险股份有限公司 | Message queue-based load balancing method and device and computer equipment |
| CN110442447A (en) * | 2019-07-05 | 2019-11-12 | 中国平安人寿保险股份有限公司 | Load-balancing method, device and computer equipment based on message queue |
| CN110768873A (en) * | 2019-10-31 | 2020-02-07 | 广州酷旅旅行社有限公司 | Distributed heartbeat detection method, system and device and computer equipment |
| CN110768873B (en) * | 2019-10-31 | 2021-08-10 | 广州酷旅旅行社有限公司 | Distributed heartbeat detection method, system and device and computer equipment |
| CN110891032A (en) * | 2019-11-27 | 2020-03-17 | 佛山市蠢材科技有限公司 | Face data parallel issuing method and device and electronic equipment |
| CN115280740A (en) * | 2020-01-14 | 2022-11-01 | 第一资本服务有限责任公司 | Techniques for providing streaming data resiliency using a distributed message queue system |
| CN111314114A (en) * | 2020-01-19 | 2020-06-19 | 苏州浪潮智能科技有限公司 | Deployment method and system for improving high availability of RabbitMQ |
| CN111787058A (en) * | 2020-05-26 | 2020-10-16 | 北京航空航天大学 | Lightweight information subscription and push method in cross-domain virtual data space |
| CN111897656B (en) * | 2020-08-06 | 2022-08-16 | 北京中电兴发科技有限公司 | Main queue load balancing method based on mirror image queue |
| CN111897656A (en) * | 2020-08-06 | 2020-11-06 | 北京中电兴发科技有限公司 | Main queue load balancing method based on mirror image queue |
| CN112738156A (en) * | 2020-12-11 | 2021-04-30 | 广东电力通信科技有限公司 | Independent mirror image management method suitable for intelligent gateway |
| CN112738156B (en) * | 2020-12-11 | 2023-05-26 | 广东电力通信科技有限公司 | Independent mirror image management method suitable for intelligent gateway |
| CN114095280A (en) * | 2022-01-20 | 2022-02-25 | 苏州浪潮智能科技有限公司 | Cloud platform server communication channel construction method, communication method, device and server |
| CN114095280B (en) * | 2022-01-20 | 2022-04-19 | 苏州浪潮智能科技有限公司 | Cloud platform server communication channel construction method, communication method, device and server |
| CN115150031A (en) * | 2022-06-20 | 2022-10-04 | 中国工商银行股份有限公司 | Distributed system message response method and device based on distributed messages |
| CN115150031B (en) * | 2022-06-20 | 2024-02-27 | 中国工商银行股份有限公司 | Distributed system message response method and device based on distributed message |
| CN115097941A (en) * | 2022-07-13 | 2022-09-23 | 北京百度网讯科技有限公司 | Human interaction detection method, human interaction detection device, human interaction detection equipment and storage medium |
| CN115097941B (en) * | 2022-07-13 | 2023-10-10 | 北京百度网讯科技有限公司 | Character interaction detection method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104753817B (en) | 2019-02-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104753817A (en) | Local analogy method and local analogy system for cloud computing message queue service | |
| CN112799789B (en) | Node cluster management method, device, equipment and storage medium | |
| CN103562882B (en) | For providing the system and method for messaging application interface | |
| CN107172187B (en) | A kind of SiteServer LBS and method | |
| EP2899947A1 (en) | Component oriented hybrid cloud operating system architecture and communication method thereof | |
| CN112861190B (en) | Data cross-chain cooperation method, system and device | |
| JP2010231759A (en) | Mobile terminal device including mobile cloud platform | |
| CN113079159A (en) | Edge computing network architecture based on block chain | |
| JP2012510651A (en) | Service load balancing | |
| CN101567861B (en) | Data synchronization method and application system between heterogeneous application systems | |
| CN108804238B (en) | Soft bus communication method based on remote procedure call | |
| CN102006309A (en) | Method for performing real-time communication between manufacturing execution system (MES) and process control system (PCS) and middleware | |
| CN111338893A (en) | Process log processing method and device, computer equipment and storage medium | |
| CN103685535A (en) | Interface design of cloud database system for large-scale distributed heterogeneous data treatment | |
| CN104808606A (en) | Method for providing functions within an industrial automation system and industrial automation system | |
| JP2012512445A (en) | Configuring the message processing pipeline | |
| CN113886055B (en) | Intelligent model training resource scheduling method based on container cloud technology | |
| CN105404530B (en) | It is a kind of to realize easy deployment and the system and method using private clound | |
| Basanta‐Val et al. | Non‐functional information transmission patterns for distributed real‐time Java | |
| CN101977165A (en) | Message transmission method and message bus system in cloud mode | |
| CN107872479B (en) | Cloud management platform and controller integration method and system and related modules | |
| CN106909505A (en) | The remote test method and device of the server OS based on java | |
| CN112512022A (en) | TSN industrial application server, client, system, service method and storage medium | |
| CN113114482A (en) | Container-based hybrid cloud management system and method | |
| US8606947B2 (en) | Heuristics processing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |