CN105630574A - Container based message queue bus management system and method - Google Patents

Container based message queue bus management system and method Download PDF

Info

Publication number
CN105630574A
CN105630574A CN201510961257.8A CN201510961257A CN105630574A CN 105630574 A CN105630574 A CN 105630574A CN 201510961257 A CN201510961257 A CN 201510961257A CN 105630574 A CN105630574 A CN 105630574A
Authority
CN
China
Prior art keywords
message
container
queue
producer
consumer
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510961257.8A
Other languages
Chinese (zh)
Inventor
王毅竺
刘晓毅
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Electronic Technology Cyber Security Co Ltd
Original Assignee
China Electronic Technology Cyber Security Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Electronic Technology Cyber Security Co Ltd filed Critical China Electronic Technology Cyber Security Co Ltd
Priority to CN201510961257.8A priority Critical patent/CN105630574A/en
Publication of CN105630574A publication Critical patent/CN105630574A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/455Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533Hypervisors; Virtual machine monitors
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/54Interprogram communication
    • G06F9/546Message passing systems or structures, e.g. queues

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The invention discloses a container based message queue bus management system. The container based message queue bus management system comprises a Broker message queue service entity. And the container based message queue bus management system comprises a receiving message queue connected with the Broker message queue service entity. A message queue is repackaged and transformed to obtain a message producer container containing a message of message queue data, a message module containing the message queue data, and a message consumer container for receiving messages and carrying out selective response processing according to self-response types. The invention further discloses a message queue bus management method. According to the message queue bus management system and method disclosed by the invention, by using the container and rapid deployment and expansion capabilities of the container, concurrent processing capability of the message queue is improved, and message queue blocking is avoided, so that even if one container has a problem, normal operations of other containers cannot be affected, and the containers are independent with each other and are without interference with each other.

Description

A kind of message queue bus management system based on container and method
Technical field
The present invention relates to container application Intel Virtualization Technology association area, particularly relate to a kind of message queue bus management system based on container and method.
Background technology
MSMQ (Message Queuing Services) can provide message queue, Route Selection and directory service for client computer. Message Queuing server may be used for: provides message Route Selection and session to concentrate for separate customer, message Route Selection is provided between by the website of routing link, create queue and store the message for subordinate client. in traditional Message Queuing Services, owing to message queue is excessive, the situation that message queue blocks often occurs, cause message to transmit unsuccessfully. traditional MSMQ message queue structure as shown in Figure 1, usual message queue way uses Queue as message carrier, route binding and the channel selecting of Queue it is responsible for by Exchange message queue switch, Broker is responsible for overall scheduling, when data volume is excessive, pressure arises that the part at Broker and Exchange, and all of Vhost shares a message Producer Producer, once there be the message blocking message Producer Producer of a Vhost, other Vhost also cannot use message Producer, whole message queue passage just will be unable to use.
Summary of the invention
In order to solve the problems referred to above, the present invention provides a kind of rapid deployment utilizing container and extended capability to improve the concurrent processing ability of message queue, the message queue bus management system based on container avoiding message queue to block and method.
A kind of message queue bus management system based on container of the present invention, including Broker Message Queuing Services entity, message queue is also carried out Reseal and reforming processing obtains the message Producer container of message comprising message queue data, the message module comprising message queue data, receives message information the message consumer's container according to self respond style selectivity response process by what the described message queue bus management system based on container included being connected with described Broker Message Queuing Services entity receive message queue.
A kind of message queue bus management method based on container, is realized by the message queue bus management system based on container, comprises the steps:
S1, the message Producer container that establishment comprises message Producer and the message consumer's container comprising message consumer, enter step s2;
S2, by described message Producer obtain message content, enter step s3;
S3, by described message Producer container decoded message content, and message content be packaged and transform, producing APR Response List and queue calling message, enter step s4;
S4, message Producer container send ARP message to message consumer's container, enter step s5;
S5, described message consumer's container decoding ARP message, enters step s6;
S6, described message consumer's container judge whether self respond style mates with ARP type of message, if coupling, enter step s8, if not mating, enter step s7;
S7, described message consumer's container not back message;
S8, described message consumer's container are receiveed the response Producer, enter step s9;
S9, message Producer determine the response of message consumer, obtain the MAC Address of the APR corresponding ports that message consumer responds, and send call queue message to the message consumer sending response, enter step s10;
S10, message consumer process the message content in message, enter step s11;
S11, return result.
The present invention utilizes the rapid deployment of container and extended capability to improve the concurrent processing ability of message queue, avoid message queue to block by container, even if a container goes wrong, without influence on the normal operation of other containers, separate between container, it is independent of each other.
Accompanying drawing explanation
Fig. 1 is MSMQ message queue structural representation traditional under prior art;
Fig. 2 is the message queue bus management system structural representation based on container of the present invention;
Fig. 3 is the message structure schematic diagram of the message queue bus management system based on container of the present invention;
Fig. 4 is the message response header structure schematic diagram of the message queue bus management system based on container of the present invention;
Fig. 5 is the message queue bus management method schematic flow sheet based on container of the present invention.
Detailed description of the invention
In order to be better understood from the present invention, describe the present invention in detail below in conjunction with accompanying drawing.
As shown in Figure 2, a kind of message queue bus management system based on container of the present invention, including Broker Message Queuing Services entity, it is characterized in that, message queue is also carried out Reseal and reforming processing obtains comprising the message Producer container of the message of message queue data by what the described message queue bus management system based on container included being connected with described Broker Message Queuing Services entity receive message queue, comprise the message module of message queue data, receive message information the message consumer's container according to self respond style selectivity response process.
Preferably, described message Producer container includes being only served in the message Producer Producer of this message Producer container, processes a class virtual switch OVS of communication across physical equipment, the message queue received is packaged and the queue messages wrapper of reforming processing for realizing described message Producer container.
Preferably, described message consumer's container include being only served in the message consumer consumer of this message Producer container, for realizing the queue messages resolver of the message information that described message consumer's container processes two class virtual switch OVS of communication across physical equipment, decoding receives.
Preferably, as it is shown on figure 3, described message module includes APR Response List and queue calling message; Described arp response list includes type head response and PortMAC table; Described queue calling message include consistent with the type head response in described arp response list mate type head response, comprise the queuing data of message queue information, message text and receive message queue result readjustment process content space.
Preferably, as shown in Figure 4, described type head response includes type designation position and type of message priority.
Described message queue bus management system includes several separate message Producer container and message consumer's containers.
As it is shown in figure 5, a kind of message queue bus management method based on container, it is characterised in that the described message queue bus management method based on container is realized by the message queue bus management system based on container, comprises the steps:
S1, the message Producer container that establishment comprises message Producer and the message consumer's container comprising message consumer, enter step s2;
S2, by described message Producer obtain message content, enter step s3;
S3, by described message Producer container decoded message content, and message content be packaged and transform, producing APR Response List and queue calling message, enter step s4;
S4, message Producer container send ARP message to message consumer's container, enter step s5;
S5, described message consumer's container decoding ARP message, enters step s6;
S6, described message consumer's container judge whether self respond style mates with ARP type of message, if coupling, enter step s8, if not mating, enter step s7;
S7, described message consumer's container not back message;
S8, described message consumer's container are receiveed the response Producer, enter step s9;
S9, message Producer determine the response of message consumer, obtain the MAC Address of the APR corresponding ports that message consumer responds, and send call queue message to the message consumer sending response, enter step s10;
S10, message consumer process the message content in message, enter step s11;
S11, return result.
Preferably, the described message Producer container of establishment includes being only served in the message Producer Producer of this message Producer container, processes a class virtual switch OVS of communication across physical equipment, the message queue received is packaged and the queue messages wrapper of reforming processing for realizing described message Producer container.
Preferably, described message consumer's container of establishment include being only served in the message consumer consumer of this message Producer container, for realizing the queue messages resolver of the message information that described message consumer's container processes two class virtual switch OVS of communication across physical equipment, decoding receives.
Preferably, described arp response list includes type head response and PortMAC table; Described queue calling message include consistent with the type head response in described arp response list mate type head response, comprise the queuing data of message queue information, message text and receive message queue result readjustment process content space.
Preferably, described type head response includes type designation position and type of message priority.
Preferably, several separate message Producer container and message consumer's containers are created.
Specifically, the appearance of Container (container), achieve and tradition is applied, B/S (browser/client) application being based particularly on network is disposed and way to manage more flexibly, also achieve isolation and the restriction of resource simultaneously, meet rapid deployment and apply diversified demand. Application virtualization based on Docker container technique, it is possible to encapsulate in the way of being exceedingly fast and application deployment. Docker mainly uses the LXC light weight based on (SuSE) Linux OS to virtualize and Cgroup resource isolation technology, and the mode encapsulated by mirror image is realized minimum environment of simplifying and meets the system environments dependence of different vessels. The vhost that consumption Producer carries out is removed, it is put in the container of Docker and has run, utilize the isolation of container and the technology of dynamic expansion, multiple container can be run on a Broker, high encapsulation and isolation characteristic due to Docker, namely ensure that the independence that consumption Producer runs also ensure that the horizontal dilatation of pressure load, substantially increase the disposal ability of consumption Producer. New information carrier has been split into 2 parts, and a part is arp response list, and a part is queue calling message, using type head response as relation KEY, makes arp response list call message with corresponding queue and matches. Corresponding message content queue messages resolver completes, and message consumer is obtained corresponding message queue data by queue messages resolver. The message queue data of the present invention are made up of 2 classes, and a class is arp response list, and another kind of is queue calling message. Calling real message content in message in queue and be stored in message text, the result of message leaves readjustment in and processes in content space. The present invention utilizes the flattening network that OVS virtual switch can realize big two layers, all of container can be processed communication in the virtual switch being placed on two layers of physical equipment, container technique furthermore with Docker, one or more Docker container can be produced for the message consumer of each type individually to encapsulate, so can be greatly improved the concurrent processing ability of message data.
In sum, the present invention utilizes the rapid deployment of container and extended capability to improve the concurrent processing ability of message queue, avoid message queue to block by container, even if a container goes wrong, without influence on the normal operation of other containers, between container separate, be independent of each other.
The above; it is only the present invention preferably detailed description of the invention; but protection scope of the present invention is not limited thereto; any those familiar with the art is in the technical scope of present disclosure; it is equal to replacement according to technical scheme and inventive concept thereof or is changed, all should be encompassed within protection scope of the present invention.

Claims (14)

1. the message queue bus management system based on container, including Broker Message Queuing Services entity, it is characterized in that, message queue is also carried out Reseal and reforming processing obtains the message Producer container of message comprising message queue data, the message module comprising message queue data, receives message information the message consumer's container according to self respond style selectivity response process by what the described message queue bus management system based on container included being connected with described Broker Message Queuing Services entity receive message queue.
2. the message queue bus management system based on container according to claim 1, it is characterized in that, described message Producer container includes being only served in the message Producer Producer of this message Producer container, processes a class virtual switch OVS of communication across physical equipment, the message queue received is packaged and the queue messages wrapper of reforming processing for realizing described message Producer container.
3. the message queue bus management system based on container according to claim 1, it is characterized in that, described message consumer's container includes being only served in the message consumer consumer of this message Producer container, for realizing the queue messages resolver of the message information that described message consumer's container processes two class virtual switch OVS of communication across physical equipment, decoding receives.
4. the message queue bus management system based on container according to claim 1, it is characterised in that described message module includes APR Response List and queue calling message;
Described arp response list includes type head response and PortMAC table;
Described queue calling message include consistent with the type head response in described arp response list mate type head response, comprise the queuing data of message queue information, message text and receive message queue result readjustment process content space.
5. the message queue bus management system based on container according to claim 4, it is characterised in that described type head response includes type designation position and type of message priority.
6. the message queue bus management system based on container according to claim 1, it is characterised in that described message queue bus management system includes at least one message Producer container.
7. the message queue bus management system based on container according to claim 1, it is characterised in that described message queue bus management system includes at least one message consumer's container.
8. the message queue bus management method based on container, it is characterised in that the described message queue bus management method based on container is realized by the message queue bus management system based on container, comprises the steps:
S1, the message Producer container that establishment comprises message Producer and the message consumer's container comprising message consumer, enter step s2;
S2, by described message Producer obtain message content, enter step s3;
S3, by described message Producer container decoded message content, and message content be packaged and transform, producing APR Response List and queue calling message, enter step s4;
S4, message Producer container send ARP message to message consumer's container, enter step s5;
S5, described message consumer's container decoding ARP message, enters step s6;
S6, described message consumer's container judge whether self respond style mates with ARP type of message, if coupling, enter step s8, if not mating, enter step s7;
S7, described message consumer's container not back message;
S8, described message consumer's container are receiveed the response Producer, enter step s9;
S9, message Producer determine the response of message consumer, obtain the MAC Address of the APR corresponding ports that message consumer responds, and send call queue message to the message consumer sending response, enter step s10;
S10, message consumer process the message content in message, enter step s11;
S11, return result.
9. the message queue bus management method based on container according to claim 8, it is characterized in that, the described message Producer container of establishment includes being only served in the message Producer Producer of this message Producer container, processes a class virtual switch OVS of communication across physical equipment, the message queue received is packaged and the queue messages wrapper of reforming processing for realizing described message Producer container.
10. the message queue bus management method based on container according to claim 8, it is characterized in that, described message consumer's container of establishment includes being only served in the message consumer consumer of this message Producer container, for realizing the queue messages resolver of the message information that described message consumer's container processes two class virtual switch OVS of communication across physical equipment, decoding receives.
11. the message queue bus management method based on container according to claim 8, it is characterised in that described arp response list includes type head response and PortMAC table; Described queue calling message include consistent with the type head response in described arp response list mate type head response, comprise the queuing data of message queue information, message text and receive message queue result readjustment process content space.
12. the message queue bus management method based on container according to claim 11, it is characterised in that described type head response includes type designation position and type of message priority.
13. the message queue bus management method based on container according to claim 1, it is characterised in that create at least one message Producer container.
14. the message queue bus management method based on container according to claim 1, it is characterised in that described message queue bus management system includes at least one message consumer's container.
CN201510961257.8A 2015-12-21 2015-12-21 Container based message queue bus management system and method Pending CN105630574A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510961257.8A CN105630574A (en) 2015-12-21 2015-12-21 Container based message queue bus management system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510961257.8A CN105630574A (en) 2015-12-21 2015-12-21 Container based message queue bus management system and method

Publications (1)

Publication Number Publication Date
CN105630574A true CN105630574A (en) 2016-06-01

Family

ID=56045553

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510961257.8A Pending CN105630574A (en) 2015-12-21 2015-12-21 Container based message queue bus management system and method

Country Status (1)

Country Link
CN (1) CN105630574A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107070691A (en) * 2017-01-12 2017-08-18 阿里巴巴集团控股有限公司 Docker containers across host communication method and system
TWI697217B (en) * 2019-01-30 2020-06-21 中華電信股份有限公司 Container control system for repeatedly executing serverless programs and method thereof

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101184056A (en) * 2007-12-04 2008-05-21 浙江大学 Distributed enterprise service bus message switching method
CN103227747A (en) * 2012-03-14 2013-07-31 微软公司 High density hosting for messaging service
CN104754036A (en) * 2015-03-06 2015-07-01 合一信息技术(北京)有限公司 Message processing system and processing method based on kafka
US20150256481A1 (en) * 2014-03-06 2015-09-10 Jisto Inc. Elastic Compute Cloud Based On Underutilized Server Resources Using A Distributed Container System
CN104951360A (en) * 2015-06-30 2015-09-30 北京奇虎科技有限公司 Configuration management mode and device based on Docker

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101184056A (en) * 2007-12-04 2008-05-21 浙江大学 Distributed enterprise service bus message switching method
CN103227747A (en) * 2012-03-14 2013-07-31 微软公司 High density hosting for messaging service
US20150256481A1 (en) * 2014-03-06 2015-09-10 Jisto Inc. Elastic Compute Cloud Based On Underutilized Server Resources Using A Distributed Container System
CN104754036A (en) * 2015-03-06 2015-07-01 合一信息技术(北京)有限公司 Message processing system and processing method based on kafka
CN104951360A (en) * 2015-06-30 2015-09-30 北京奇虎科技有限公司 Configuration management mode and device based on Docker

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
KYUNG-HWA KIM: "Flexible network address mapping for container-based clouds", 《IEEE》 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107070691A (en) * 2017-01-12 2017-08-18 阿里巴巴集团控股有限公司 Docker containers across host communication method and system
CN107070691B (en) * 2017-01-12 2020-01-21 阿里巴巴集团控股有限公司 Cross-host communication method and system of Docker container
TWI697217B (en) * 2019-01-30 2020-06-21 中華電信股份有限公司 Container control system for repeatedly executing serverless programs and method thereof

Similar Documents

Publication Publication Date Title
US9602307B2 (en) Tagging virtual overlay packets in a virtual networking system
US10044622B2 (en) Load balancing for a virtual networking system
US20210029077A1 (en) Managing network connectivity between cloud computing service endpoints and virtual machines
AU2013409674B2 (en) Data transmission method, data forwarding device, and system
CN102880475B (en) Based on the real-time event disposal system of cloud computing and method in computer software
CN109302466B (en) Data processing method, related device and computer storage medium
US7957407B2 (en) Heterogeneous media packet bridging
US11095716B2 (en) Data replication for a virtual networking system
CN112398688B (en) Container network configuration method, container network system, and storage medium
CN108293022A (en) A kind of methods, devices and systems of message transmissions
JP6076480B2 (en) Service processing method and apparatus
CN104243265A (en) Gateway control method, device and system based on virtual machine migration
CN105939365A (en) Method and device for obtaining data from service panel kernel mode by main control panel user mode
CN107018058A (en) The method and system of VLAN and VXLAN communications are shared under a kind of cloud environment
CN105630574A (en) Container based message queue bus management system and method
CN117061352A (en) Method, device, equipment and medium for implementing multi-mode virtual network element
CN112583655B (en) Data transmission method and device, electronic equipment and readable storage medium
EP4120641A1 (en) Method and device for dynamic and efficient load balancing in mobile communication network
CN108123865B (en) Message processing method and device
EP3369217B1 (en) Multiple gateway operation on single operating system
WO2021135792A1 (en) Data forwarding method, forwarding device, system, server, and storage medium
CN105939242B (en) Realize the method and device of virtual system
CN106230740A (en) Message forwarding method in a kind of VXLAN and device
CN106255085B (en) Multi-media dispatcher integrated approach for EPC system
CN105955832A (en) Method and system for intercommunication between activity and fragments in device screen

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20160601

WD01 Invention patent application deemed withdrawn after publication