CN111541667A - Method, equipment and storage medium for intersystem message communication - Google Patents
Method, equipment and storage medium for intersystem message communication Download PDFInfo
- Publication number
- CN111541667A CN111541667A CN202010300915.XA CN202010300915A CN111541667A CN 111541667 A CN111541667 A CN 111541667A CN 202010300915 A CN202010300915 A CN 202010300915A CN 111541667 A CN111541667 A CN 111541667A
- Authority
- CN
- China
- Prior art keywords
- message
- client
- processing center
- producer
- communication
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
Abstract
The invention discloses a method, a device and a storage medium for message communication between systems, which establish a distributed framework, wherein the distributed framework comprises a server and a client; establishing a communication protocol, and managing a message queue according to the communication protocol; the message queue receives the messages of the server and the client through a security gateway to realize message communication between systems; the message queue comprises a message producer, a message consumer and a message processing center, wherein the message producer issues a message and sends the message to the message processing center; the message processing center receives and stores the message sent by the message producer, and forwards the message to the message consumer; and the message consumer subscribes the message of the message processing center and processes the message. The invention meets the system communication under the requirements of high concurrency and high performance, and the throughput and the message accumulation capacity of the message meet the system requirements.
Description
Technical Field
The present invention relates to the field of communications technologies, and in particular, to a method, an apparatus, and a storage medium for communicating according to an intersystem message.
Background
When the application in the system is large, the application can be split into a plurality of applications to be deployed on a plurality of machines, but the machines are not completely independent and need to communicate with each other to realize a common service. Communication among a plurality of applications needs to be achieved through intersystem communication, existing intersystem communication is mainly achieved through a remote calling mode or a message queue mode, but the remote calling mode cannot meet the application scenario under the high concurrency and high performance requirements, and the message throughput and the message accumulation capacity cannot meet the requirements.
Disclosure of Invention
In order to overcome the defects of the prior art, the invention aims to provide a method for intersystem message communication, which meets the system communication requirement under the high concurrency and high performance requirements, and the message throughput and the message accumulation capacity meet the system requirement.
Another object of the present invention is to provide an electronic device, which performs the above method for message communication between systems;
it is a further object of the present invention to provide a storage medium for performing the above-mentioned method for intersystem message communication.
One of the purposes of the invention is realized by adopting the following technical scheme:
a method for intersystem message communication, comprising the steps of
Establishing a distributed framework, wherein the distributed framework comprises a server and a client;
establishing a communication protocol, and managing a message queue according to the communication protocol; the message queue receives the messages of the server and the client through a security gateway to realize message communication between systems;
the message queue comprises a message producer, a message consumer and a message processing center, wherein the message producer issues a message and sends the message to the message processing center;
the message processing center receives and stores the message sent by the message producer, and forwards the message to the message consumer;
and the message consumer subscribes the message of the message processing center and processes the message.
Further, the messages are stored in the message processing center in the form of file groups, and the sizes of the single files in the file groups are the same.
Further, the files in the file group are arranged in sequence based on the time sequence received by the message processing center.
Further, the message producer issuing the message and sending the message to the message processing center comprises the following steps:
a message producer of the client generates a message and sends a message sending request;
the server receives and processes the issue request of the client and returns a response to store the message generated by the message producer;
the client receives and processes the returned response, and the message producer successfully releases the message.
Further, the message consumer subscribes to the message of the message processing center and processes the message, and the method comprises the following steps:
a message consumer at a client sends a message receiving request;
the server receives and processes the subscription request of the client and returns a response;
the client receives and processes the message from the server, the message consumer subscribes the message successfully, and begins to consume the message of the message queue.
Further, the distributed framework coordinates the framework Zookeeper for the distributed application.
Further, the client and the server realize message intercommunication through the security gateway.
The second purpose of the invention is realized by adopting the following technical scheme:
an apparatus comprising a processor, a memory and a computer program stored on the memory and executable on the processor, the processor when executing the computer program implementing a method of intersystem message communication as described above.
The third purpose of the invention is realized by adopting the following technical scheme:
a storage medium having stored thereon a computer program which, when executed, implements a method of intersystem message communication as set out above.
Compared with the prior art, the invention has the beneficial effects that:
the invention provides a method, equipment and a storage medium for intersystem message communication, which meet the intersystem communication applied under the requirements of high concurrency and high performance by publishing a subscription mode, provide message transmission service for a distributed system and ensure the high efficiency and reliability of intersystem message transmission.
Drawings
FIG. 1 is a schematic flow chart of a first embodiment of the present invention;
FIG. 2 is a diagram of a message queue according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of a second embodiment of the present invention.
Detailed Description
The present invention will be further described with reference to the accompanying drawings and the detailed description, and it should be noted that any combination of the embodiments or technical features described below can be used to form a new embodiment without conflict.
Example one
As shown in fig. 1 and 2, the present invention provides a method for intersystem message communication, which comprises the following steps:
and step S1, establishing a distributed coordination framework, wherein the distributed coordination framework comprises a server and a client. The distributed coordination framework is applied to realize management of queue nodes. Generally, a distributed coordination framework includes a server and a plurality of clients. In the practical application of this embodiment, the distributed coordination framework is a distributed application program coordination framework Zookeeper, the server is a Zookeeper server, and the client provides the functions of configuration maintenance, name service and cluster management for the Zookeeper client on the Zookeeper server, and stores various data of the message queue in the file system of the Zookeeper.
Step S2, establishing a communication protocol, and managing a message queue according to the communication protocol; and the message queue receives the messages of the server and the client through a security gateway to realize message communication between systems. The message queue is connected with the Zookeeper server through the security gateway to realize service registration and provide communication content according to a communication protocol. The communication protocol can be a JMX protocol, can monitor the load wind information of a memory and a central processing unit on the JAVA virtual machine, manages the application on the JVM and solves the problems in distributed management. Event alarm, short message service and log backup among systems are realized through the message queue.
Specifically, the invention adopts a publish-subscribe mode, and the core functions include message sending, message storage, message routing and message consumption. The message queue comprises a message producer, a message consumer and a message processing center. The message producer issues a message and sends the message to a message processing center. Specifically, a message producer of a client generates a message and sends a message sending request; the server receives and processes the issue request of the client, returns a response, and stores the message generated by the message producer. The client issues a response for receiving and processing the return, namely the message producer issues the message successfully.
And the message processing center receives and stores the message sent by the message producer and forwards the message to the message consumer. In order to pursue high throughput of messages, the message processing center designs the storage files into a concept of a file group, the size of a single file in the file group is fixed, a memory mapping mechanism is conveniently introduced, all message storage is written based on the time sequence received by the message processing center, and message writing performance is greatly improved. Meanwhile, in order to take account of message consumption and message searching, a message consumption queue file and an index file are introduced.
And the message consumer subscribes the message of the message processing center and processes the message. The method specifically comprises the following steps: the message consumer of the client sends out a message receiving request, the server receives and processes the subscription request of the client and returns a response, and the client receives and processes the message from the server, namely the message consumer successfully subscribes the message and starts consuming the queue message.
The invention provides a method for intersystem message communication, which meets the intersystem communication applied under the requirements of high concurrency and high performance by publishing a subscription mode, provides message transmission service for a distributed system and ensures the high efficiency and reliability of intersystem message transmission.
Example two
As shown in fig. 3, an electronic device includes a memory, a processor, and a program stored in the memory, the program configured to be executed by the processor, the program when executed by the processor implementing one of the above-described method steps for intersystem message communication.
In addition, the present invention also provides a storage medium, which stores a computer program that, when being executed by a processor, implements the steps of the aforementioned method for communication by intersystem messages. The invention is operational with numerous general purpose or special purpose computing system environments or configurations. For example: personal computers, server computers, hand-held or portable devices, tablet-type devices, multiprocessor systems, microprocessor-based systems, set top boxes, programmable consumer electronics, network PCs, minicomputers, mainframe computers, distributed computing environments that include any of the above systems or devices, and the like.
The apparatus in this embodiment and the method in the foregoing embodiment are based on two aspects of the same inventive concept, and the method implementation process has been described in detail in the foregoing, so that those skilled in the art can clearly understand the structure and implementation process of the system in this embodiment according to the foregoing description, and for the sake of brevity of the description, details are not repeated here.
The above embodiments are only preferred embodiments of the present invention, and the protection scope of the present invention is not limited thereby, and any insubstantial changes and substitutions made by those skilled in the art based on the present invention are within the protection scope of the present invention.
Claims (9)
1. A method of intersystem message communication,
establishing a distributed framework, wherein the distributed framework comprises a server and a client;
establishing a communication protocol, and managing a message queue according to the communication protocol; the message queue receives the messages of the server and the client through a security gateway to realize message communication between systems;
the message queue comprises a message producer, a message consumer and a message processing center, wherein the message producer issues a message and sends the message to the message processing center;
the message processing center receives and stores the message sent by the message producer, and forwards the message to the message consumer;
and the message consumer subscribes the message of the message processing center and processes the message.
2. The method of claim 1, wherein the messages are stored in file groups in the message processing center, and the individual files in the file groups are the same size.
3. The method of claim 2, wherein the files in said set of files are arranged in a chronological order based on receipt at the message processing center.
4. The method of claim 1, wherein the message producer issuing the message and sending the message to the message processing center comprises the steps of:
a message producer of the client generates a message and sends a message sending request;
the server receives and processes the issue request of the client and returns a response to store the message generated by the message producer;
the client receives and processes the returned response, and the message producer successfully releases the message.
5. The method of claim 1, wherein a message consumer subscribes to messages of the message processing center and processes the messages comprising the steps of:
a message consumer at a client sends a message receiving request;
the server receives and processes the subscription request of the client and returns a response;
the client receives and processes the message from the server, the message consumer subscribes the message successfully, and begins to consume the message of the message queue.
6. The method of claim 1, wherein the distributed framework coordinates the framework Zookeeper for a distributed application.
7. The method of claim 1, wherein said client and server implement message interworking via said secure gateway.
8. An apparatus comprising a processor, a memory, and a computer program stored on the memory and operable on the processor, the computer program when executed by the processor implementing a method of inter-system message communication as claimed in any one of claims 1 to 7.
9. A storage medium having stored thereon a computer program which, when executed, implements a method of inter-system message communication as claimed in any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010300915.XA CN111541667A (en) | 2020-04-16 | 2020-04-16 | Method, equipment and storage medium for intersystem message communication |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010300915.XA CN111541667A (en) | 2020-04-16 | 2020-04-16 | Method, equipment and storage medium for intersystem message communication |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111541667A true CN111541667A (en) | 2020-08-14 |
Family
ID=71970355
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010300915.XA Pending CN111541667A (en) | 2020-04-16 | 2020-04-16 | Method, equipment and storage medium for intersystem message communication |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111541667A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116938897A (en) * | 2023-09-19 | 2023-10-24 | 好信云(北京)网络通信有限公司 | Method and device for real-time communication of conference |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130066977A1 (en) * | 2011-09-12 | 2013-03-14 | Microsoft Corporation | Message queue behavior optimizations |
| CN104092767A (en) * | 2014-07-21 | 2014-10-08 | 北京邮电大学 | Posting/subscribing system for adding message queue models and working method thereof |
| CN104102552A (en) * | 2013-04-15 | 2014-10-15 | 深圳中兴网信科技有限公司 | Message processing method and device |
| CN104363291A (en) * | 2014-11-19 | 2015-02-18 | 中国航天科工集团第二研究院七〇六所 | Network communication middleware implementation method |
| CN107197015A (en) * | 2017-05-23 | 2017-09-22 | 阿里巴巴集团控股有限公司 | A kind of message treatment method and device based on Message Queuing system |
| CN109150558A (en) * | 2017-06-15 | 2019-01-04 | 北京京东尚科信息技术有限公司 | The methods, devices and systems of managing message queues node |
-
2020
- 2020-04-16 CN CN202010300915.XA patent/CN111541667A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130066977A1 (en) * | 2011-09-12 | 2013-03-14 | Microsoft Corporation | Message queue behavior optimizations |
| CN104102552A (en) * | 2013-04-15 | 2014-10-15 | 深圳中兴网信科技有限公司 | Message processing method and device |
| CN104092767A (en) * | 2014-07-21 | 2014-10-08 | 北京邮电大学 | Posting/subscribing system for adding message queue models and working method thereof |
| CN104363291A (en) * | 2014-11-19 | 2015-02-18 | 中国航天科工集团第二研究院七〇六所 | Network communication middleware implementation method |
| CN107197015A (en) * | 2017-05-23 | 2017-09-22 | 阿里巴巴集团控股有限公司 | A kind of message treatment method and device based on Message Queuing system |
| CN109150558A (en) * | 2017-06-15 | 2019-01-04 | 北京京东尚科信息技术有限公司 | The methods, devices and systems of managing message queues node |
Non-Patent Citations (2)
| Title |
|---|
| AYBERK CANSEVER: "A Distributed Message Queuing Mechanism for a Mailing System with High Performance and High Availability", 《2018 6TH INTERNATIONAL CONFERENCE ON CONTROL ENGINEERING & INFORMATION TECHNOLOGY (CEIT)》 * |
| 梁霄: "面向消息中间件的设计与研究", 《信息与电脑(理论版)》 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116938897A (en) * | 2023-09-19 | 2023-10-24 | 好信云(北京)网络通信有限公司 | Method and device for real-time communication of conference |
| CN116938897B (en) * | 2023-09-19 | 2023-12-15 | 好信云(北京)网络通信有限公司 | Method and device for real-time communication of conference |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10367852B2 (en) | Multiplexed demand signaled distributed messaging | |
| CN111371892A (en) | High-concurrency distributed message pushing system and method | |
| JP2005539298A (en) | Method and system for remotely and dynamically configuring a server | |
| CN103581245A (en) | Content delivery method and system of content delivery network | |
| US20090064185A1 (en) | High-Performance XML Processing in a Common Event Infrastructure | |
| CN108712457A (en) | Back-end server dynamic load method of adjustment and device based on Nginx reverse proxys | |
| CN108600316B (en) | Data management method, system and equipment of cloud storage service | |
| US8606908B2 (en) | Wake-up server | |
| CN110837423A (en) | Method and device for automatically acquiring data of guided transport vehicle | |
| CN111338893A (en) | Process log processing method and device, computer equipment and storage medium | |
| US8930518B2 (en) | Processing of write requests in application server clusters | |
| CN112217847A (en) | Micro service platform, implementation method thereof, electronic device and storage medium | |
| CN110798495B (en) | Method and server for end-to-end message push in cluster architecture mode | |
| CN103248636A (en) | Offline download system and method | |
| CN108259605B (en) | Data calling system and method based on multiple data centers | |
| CN111541667A (en) | Method, equipment and storage medium for intersystem message communication | |
| CN101605301A (en) | A kind of group system and request message distribution method that carries out the multinode transaction | |
| CN116405547A (en) | Message pushing method and device, processor, electronic equipment and storage medium | |
| CN108076111B (en) | System and method for distributing data in big data platform | |
| CN111294383B (en) | Internet of things service management system | |
| PH12015500675B1 (en) | Method and system for transmission management of full configuration synchronization between eml-nml. | |
| CN111294231B (en) | Resource management method and system | |
| CN109600452A (en) | Server cluster, information push method and associated server | |
| CN110324367B (en) | Remote monitoring system, monitoring method and device thereof, storage medium and processor | |
| US11722451B2 (en) | Distributing event messages from a first service to additional services using a message store |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200814 |